00000001:02000400:3.0F:1787862315.688727:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787862324.542985:0:3157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787862325.480186:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1295 MB/s 00000001:01000000:3.0:1787862325.730455:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1719 MB/s 00000001:01000000:3.0:1787862325.980200:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10595 MB/s 00000020:02000000:0.0:1787862326.288865:0:3250:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_108_ga833322 00000400:02000000:3.0:1787862326.643688:0:3265:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.160@tcp [8/256/0/180] 00008000:02000000:2.0F:1787862330.629154:0:3414:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787862388.136402:0:5220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787862399.384637:0:5796:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787862399.384644:0:5796:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787862399.384774:0:5796:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000195c065e 00000080:02000400:2.0:1787862399.384786:0:5796:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787862399.394405:0:5796:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787862399.394421:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787862399.394871:0:5796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004772e632) 00000020:00000080:3.0:1787862399.394896:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787862399.438291:0:5796:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787862399.440134:0:5796:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787862399.499859:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787862399.503460:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787862399.503495:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787862399.503555:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787862399.503583:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787862399.510901:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787862399.510924:0:5796:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787862399.510938:0:5796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892f968 00000020:01000004:0.0:1787862399.510948:0:5796:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787862399.510954:0:5796:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787862399.510962:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000195c065e from MGS 00000020:01000004:0.0:1787862399.510968:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787862399.511009:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000821b3fc3) 00000020:00000080:0.0:1787862399.511025:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787862399.511169:0:5796:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000195c065e from MGS, refs=2 00080000:01000000:0.0:1787862399.511176:0:5796:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787862399.511181:0:5796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892f976 00000100:00100000:0.0:1787862399.511335:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787862399.511467:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787862399.511474:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787862399.512682:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787862399.512692:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787862399.513711:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862399.513895:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787862399.513901:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787862399.516155:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787862399.516176:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787862399.525633:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787862399.525671:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1787862399.526413:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862399.526423:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862399.526425:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862399.526635:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862399.526637:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862399.526638:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862399.531076:0:5796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787862399.537466:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787862399.780364:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1951 MB/s 00000001:01000000:1.0:1787862400.032995:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2543 MB/s 00000001:01000000:0.0:1787862400.285324:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 428 MB/s 00000001:01000000:2.0:1787862400.536289:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 553 MB/s 00010000:00010000:1.0:1787862400.540621:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787862400.558385:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787862400.581761:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787862400.581794:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787862400.581797:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787862400.591679:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787862400.591764:0:5796:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787862400.591838:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787862400.592397:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787862400.592427:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787862400.592763:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862400.593471:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787862400.593478:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787862400.604009:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787862400.604134:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787862400.604586:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787862400.604593:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787862400.606753:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787862400.606777:0:5796:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.160@tcp' 00000020:01000004:3.0:1787862400.606779:0:5796:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1787862400.606930:0:5811:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1787862400.607230:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.160@tcp (typ=mgc) 00000020:00000080:3.0:1787862400.607247:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.160@tcp (0000000079d5c5c6) 00000020:00000080:3.0:1787862400.607267:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787862400.607364:0:5796:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae66d33a@MGC192.168.202.160@tcp: add connection 192.168.202.160@tcp at head 00010000:00010000:3.0:1787862400.607539:0:5796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.160@tcp-0 is initialized 00000040:01000000:3.0:1787862400.607546:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787862400.629516:0:5813:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787862400.645726:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.160@tcp (uuid 43a6d3ac-1408-47c4-9e06-195b8e037a27) 00000020:00000080:0.0:1787862400.645755:0:5796:0:(genops.c:1385:class_connect()) connect: client 43a6d3ac-1408-47c4-9e06-195b8e037a27, cookie 0x9c5536ccf892f984 00000100:00080000:0.0:1787862400.645767:0:5796:0:(import.c:510:import_select_connection()) MGC192.168.202.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787862400.645772:0:5796:0:(import.c:624:import_select_connection()) MGC192.168.202.160@tcp: import 00000000ae66d33a using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787862400.645805:0:5796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e889952c x1874709526347904/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787862400.645830:0:5796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 43a6d3ac-1408-47c4-9e06-195b8e037a27->MGS 00000020:01000004:0.0:1787862400.645846:0:5796:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787862400.645851:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787862400.645871:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f119bc3a) 00000020:00000080:0.0:1787862400.645883:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787862400.662109:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e889952c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:43a6d3ac-1408-47c4-9e06-195b8e037a27:3280:1874709526347904:0@lo:250: 00000100:00100000:3.0:1787862400.662436:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862400.662562:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526347904 00000100:00100000:0.0:1787862400.662572:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526347904 00000100:00100000:0.0:1787862400.662609:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862400.662618:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed13b3e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3280:x1874709526347904:12345-0@lo:250: 00010000:00080000:0.0:1787862400.662646:0:5808:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 43a6d3ac-1408-47c4-9e06-195b8e037a27@0@lo t0 exp 0000000000000000 cur 126 last 0 00000020:00000080:0.0:1787862400.662677:0:5808:0:(genops.c:1385:class_connect()) connect: client 43a6d3ac-1408-47c4-9e06-195b8e037a27, cookie 0x9c5536ccf892f992 00000100:00080000:0.0:1787862400.662818:0:5808:0:(import.c:65:import_set_state_nolock()) 00000000e84dcb65 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862400.662889:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed13b3e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:3280:x1874709526347904:12345-0@lo:250: Request processed in 271us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862400.662898:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862400.663036:0:3280:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787862400.663109:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.160@tcp: connect to target with instance 0 00000100:00080000:3.0:1787862400.663126:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787862400.663131:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787862400.663134:0:3280:0:(import.c:65:import_set_state_nolock()) 00000000ae66d33a MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787862400.663137:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787862400.664902:0:3280:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787862400.664920:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e889952c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:43a6d3ac-1408-47c4-9e06-195b8e037a27:3280:1874709526347904:0@lo:250: 00000100:00100000:1.0:1787862400.668127:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862400.668388:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862400.668395:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787862400.679283:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862400.679296:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787862400.679944:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862400.679952:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787862400.680906:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862400.681116:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787862400.681128:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787862400.681636:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787862400.681644:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787862400.742385:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862400.742603:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787862400.742610:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787862400.745007:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787862400.745024:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787862400.745824:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862400.746013:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787862400.746018:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787862400.747760:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787862400.747775:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787862400.749037:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862400.749286:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787862400.749292:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787862400.749824:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787862400.749831:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787862400.750527:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862400.750667:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787862400.750672:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787862400.757642:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787862400.757777:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787862400.792753:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862400.793035:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862400.793061:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787862400.796753:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787862400.796769:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787862400.798311:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862400.798328:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787862400.815596:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787862400.815634:0:5796:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787862400.815642:0:5796:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787862400.815800:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787862400.815842:0:5796:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787862400.815846:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787862400.815848:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862400.815849:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862400.815851:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862400.815852:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862400.815853:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862400.815854:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862400.815856:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862400.815857:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862400.815858:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862400.815860:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862400.815861:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862400.815866:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787862400.815869:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862400.815870:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862400.815871:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862400.815872:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862400.815873:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862400.815873:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862400.815874:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862400.815886:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862400.815887:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862400.815888:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862400.815889:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862400.815890:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862400.815937:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787862400.815959:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002288f5ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348032:0@lo:253: 00000100:00100000:2.0:1787862400.816070:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862400.816122:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000000390904b going to sleep for 11 seconds 00000100:00100000:1.0:1787862400.816506:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348032 00000100:00100000:1.0:1787862400.816515:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348032 00000100:00100000:1.0:1787862400.816580:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862400.816589:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba92dd1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5796:x1874709526348032:12345-0@lo:253: 20000000:01000000:1.0:1787862400.816639:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787862400.816642:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787862400.824923:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787862400.825125:0:5810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787862400.825500:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862400.827137:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787862400.827580:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787862400.827586:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787862400.827592:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787862400.827595:0:5810:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787862400.827611:0:5810:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787862400.827824:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862400.828103:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787862400.828115:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787862400.828157:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787862400.828210:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787862400.828245:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787862400.828324:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787862400.828332:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787862400.828372:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787862400.828380:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787862400.828406:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787862400.828412:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787862400.828439:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787862400.828495:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787862400.828525:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787862400.828530:0:5810:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787862400.828544:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862400.828735:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787862400.828745:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787862400.828779:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787862400.828809:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787862400.828850:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787862400.828860:0:5810:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787862400.828925:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787862400.828933:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787862400.828989:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787862400.829063:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787862400.829103:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787862400.829116:0:5810:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787862400.829213:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787862400.829223:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787862400.829256:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787862400.829292:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787862400.829457:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787862400.829508:0:5810:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787862400.829515:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787862400.836546:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787862400.841512:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787862400.841544:0:5810:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.160@tcp for mdt 20000000:01000000:1.0:1787862400.841548:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:1.0:1787862400.841585:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787862400.841594:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787862400.841656:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787862400.841665:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:1.0:1787862400.841716:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787862400.841729:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787862400.841762:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787862400.841813:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787862400.841876:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787862400.841879:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787862400.841883:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787862400.841906:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787862400.841909:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787862400.841938:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787862400.841940:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787862400.842537:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787862400.842775:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787862400.842822:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787862400.842881:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1787862400.842895:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787862400.842897:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787862400.843370:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787862400.843602:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787862400.843645:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787862400.843679:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787862400.843694:0:5810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787862400.843696:0:5810:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787862400.843700:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787862400.843703:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787862400.843714:0:5810:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787862400.843720:0:5810:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787862400.845553:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787862400.845699:0:5810:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787862400.854021:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787862400.854458:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787862400.854535:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787862400.854562:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787862400.854584:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854599:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854609:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854615:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854621:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854627:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854632:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076ef4490 already unused, calling callback (00000000cf3a3f32) 00010000:00010000:1.0:1787862400.854635:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854661:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854674:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854681:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862400.854687:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f999 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787862400.854704:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787862401.067710:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba92dd1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5796:x1874709526348032:12345-0@lo:253: Request processed in 251114us (251632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.067727:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862401.067842:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002288f5ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348032:0@lo:253: 10000000:01000000:2.0:1787862401.067859:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787862401.067862:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787862401.067864:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862401.067865:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862401.067867:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787862401.067868:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862401.067869:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862401.067886:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862401.067887:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862401.067889:0:5796:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787862401.067891:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862401.067892:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787862401.067913:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000195c065e from lustre-MDT0000 10000000:01000000:2.0:1787862401.067941:0:5796:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787862401.067944:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787862401.067949:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a653aa2b490 10000000:01000000:2.0:1787862401.067953:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862401.067962:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a653aa2b490 from 1 10000000:01000000:2.0:1787862401.067965:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787862401.068005:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.068015:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.068021:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862401.068036:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002288f5ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348160:0@lo:101: 00000100:00100000:2.0:1787862401.068086:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.068157:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348160 00000100:00100000:2.0:1787862401.068160:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000008671e068 going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.068164:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348160 00000100:00100000:0.0:1787862401.068279:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862401.068289:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe4b7cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5796:x1874709526348160:12345-0@lo:101: 00010000:00010000:0.0:1787862401.068305:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862401.068319:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad38744f/0x9c5536ccf892f9a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892f9a0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.068342:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad38744f/0x9c5536ccf892f9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.068350:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad38744f/0x9c5536ccf892f9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.068360:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad38744f, rc 0) 00000100:00100000:0.0:1787862401.068406:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe4b7cf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+6:5796:x1874709526348160:12345-0@lo:101: Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.068412:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862401.068474:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002288f5ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348160:0@lo:101: 00010000:00010000:2.0:1787862401.068486:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.068494:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862401.068539:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002288f5ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348288:0@lo:501: 00000100:00100000:2.0:1787862401.068619:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862401.068634:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000008671e068 going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.068655:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348288 00000100:00100000:0.0:1787862401.068659:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348288 00000100:00100000:0.0:1787862401.068781:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862401.068788:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feef5aea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+6:5796:x1874709526348288:12345-0@lo:501: 00000100:00100000:2.0:1787862401.069466:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feef5aea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+6:5796:x1874709526348288:12345-0@lo:501: Request processed in 675us (842us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862401.069482:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862401.069495:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002288f5ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348288:0@lo:501: 10000000:01000000:0.0:1787862401.069527:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787862401.069597:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.069608:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000d4b3e7a3/0x9c5536ccf892f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862401.069617:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a65091a1800 10000000:01000000:0.0:1787862401.069622:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787862401.069627:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a65091a1800 10000000:01000000:0.0:1787862401.069629:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787862401.069632:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a65091a1800 from 1 10000000:01000000:0.0:1787862401.069635:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787862401.069662:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.069670:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.069678:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862401.069706:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f76e9a4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348416:0@lo:101: 00000100:00100000:0.0:1787862401.069737:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.069770:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ef74d6 going to sleep for 11 seconds 00000100:00100000:1.0:1787862401.069901:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348416 00000100:00100000:1.0:1787862401.069908:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348416 00000100:00100000:1.0:1787862401.069947:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862401.069954:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b980303d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+6:5796:x1874709526348416:12345-0@lo:101: 00010000:00010000:1.0:1787862401.069964:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862401.069977:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892f9ae expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.069997:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892f9ae expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.070007:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076ef4490/0x9c5536ccf892f9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892f9ae expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.070013:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076ef4490, rc 0) 00000100:00100000:1.0:1787862401.070104:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b980303d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+7:5796:x1874709526348416:12345-0@lo:101: Request processed in 151us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862401.070116:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787862401.070250:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f76e9a4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348416:0@lo:101: 00010000:00010000:2.0:1787862401.070262:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.070270:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862401.070286:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787862401.071506:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.071524:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 000000005eea1c7b/0x9c5536ccf892f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862401.071532:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787862401.071542:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862401.071550:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a65091a1800 10000000:01000000:2.0:1787862401.071553:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787862401.071557:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787862401.071560:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787862401.071590:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.071597:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.071617:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862401.071636:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348544:0@lo:101: 00000100:00100000:2.0:1787862401.071706:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862401.071792:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060b00d5c going to sleep for 11 seconds 00000100:00100000:1.0:1787862401.072017:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348544 00000100:00100000:1.0:1787862401.072026:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348544 00000100:00100000:1.0:1787862401.072152:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862401.072161:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b97b7cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+7:5796:x1874709526348544:12345-0@lo:101: 00010000:00010000:1.0:1787862401.072173:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862401.072186:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c335558c/0x9c5536ccf892f9c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892f9bc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.072217:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c335558c/0x9c5536ccf892f9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.072227:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c335558c/0x9c5536ccf892f9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.072234:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c335558c, rc 0) 00000100:00100000:1.0:1787862401.072281:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b97b7cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+8:5796:x1874709526348544:12345-0@lo:101: Request processed in 122us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862401.072287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787862401.072368:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348544:0@lo:101: 00010000:00010000:2.0:1787862401.072394:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.072402:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862401.072460:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348672:0@lo:501: 00000100:00100000:2.0:1787862401.072486:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862401.072647:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060b00d5c going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.072834:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348672 00000100:00100000:0.0:1787862401.072839:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348672 00000100:00100000:0.0:1787862401.072863:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862401.072901:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004becacf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+8:5796:x1874709526348672:12345-0@lo:501: 00000100:00100000:0.0:1787862401.073339:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004becacf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5796:x1874709526348672:12345-0@lo:501: Request processed in 447us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.073347:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787862401.073509:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348672:0@lo:501: 00000100:00100000:2.0:1787862401.073554:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348800:0@lo:503: 00000100:00100000:2.0:1787862401.073595:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862401.073625:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060b00d5c going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.073804:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348800 00000100:00100000:0.0:1787862401.073809:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348800 00000100:00100000:0.0:1787862401.073832:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862401.073837:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000062b176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5796:x1874709526348800:12345-0@lo:503: 00000100:00100000:0.0:1787862401.074177:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000062b176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5796:x1874709526348800:12345-0@lo:503: Request processed in 339us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.074185:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862401.074281:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526348800:0@lo:503: 00000100:00100000:2.0:1787862401.075217:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5838:1874709526348928:0@lo:502: 00000100:00100000:2.0:1787862401.075286:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862401.075330:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099a03bd4 going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.075457:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526348928 00000100:00100000:0.0:1787862401.075463:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526348928 00000100:00100000:0.0:1787862401.075547:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862401.075557:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000972802c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5838:x1874709526348928:12345-0@lo:502: 00000100:00100000:0.0:1787862401.075872:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000972802c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5838:x1874709526348928:12345-0@lo:502: Request processed in 317us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.075889:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787862401.076097:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5838:1874709526348928:0@lo:502: 00000020:01000000:2.0:1787862401.076132:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862401.076143:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862401.076146:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787862401.076151:0:5838:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787862401.076154:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862401.076179:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000f5bb4ba) 00000020:00000080:2.0:1787862401.076219:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787862401.076227:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787862401.076315:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787862401.076324:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892f9d1 00000020:00000080:2.0:1787862401.076821:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787862401.076826:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862401.076830:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862401.076832:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787862401.076835:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862401.076838:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862401.076840:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787862401.076842:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862401.076850:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004fbe916e) 00000020:00000080:2.0:1787862401.076861:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787862401.076865:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787862401.076867:0:5838:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787862401.076869:0:5838:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787862401.076887:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787862401.077351:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000195c065e from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787862401.077370:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000068a2aad5) 00000020:00000080:3.0:1787862401.077391:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787862401.077443:0:5838:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787862401.077449:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf892f9e6 00000020:00000080:3.0:1787862401.077566:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787862401.077573:0:5838:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787862401.077577:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c5536ccf892f9ed 00080000:01000000:3.0:1787862401.077583:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787862401.077587:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892f9f4 00080000:10000000:3.0:1787862401.078036:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787862401.078620:0:5838:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787862401.084389:0:5838:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787862401.163002:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787862401.163715:0:5838:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787862401.168177:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787862401.168622:0:5838:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787862401.229703:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004a8b25a9) 00000020:00000080:2.0:1787862401.229741:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787862401.229826:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787862401.229833:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892fa02 00000020:00000080:2.0:1787862401.230647:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787862401.239035:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862401.312272:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862401.339937:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862401.374773:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862401.434629:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862401.499792:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787862401.536040:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c5536ccf892fa09 00000020:00000080:1.0:1787862401.536542:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787862401.536553:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862401.536559:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862401.536561:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787862401.536564:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862401.536568:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862401.536569:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862401.536571:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862401.536573:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787862401.536575:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862401.536577:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862401.536578:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787862401.536580:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862401.536585:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862401.536586:0:5838:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787862401.536590:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787862401.536624:0:5838:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787862401.536677:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ee8bb98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5838:1874709526349056:0@lo:502: 00000100:00100000:1.0:1787862401.536759:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.536815:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058e53e9d going to sleep for 11 seconds 00000100:00100000:3.0:1787862401.537149:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349056 00000100:00100000:3.0:1787862401.537157:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349056 00000100:00100000:3.0:1787862401.537210:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862401.537220:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7fa857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5838:x1874709526349056:12345-0@lo:502: 00000100:00100000:3.0:1787862401.537543:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7fa857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5838:x1874709526349056:12345-0@lo:502: Request processed in 324us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862401.537552:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787862401.537690:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ee8bb98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5838:1874709526349056:0@lo:502: 00000020:01000000:2.0:1787862401.537718:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862401.537729:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862401.537731:0:5838:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787862401.537735:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787862401.537897:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787862401.537915:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787862401.537934:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.537945:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 000000004aee1cfe/0x9c5536ccf892f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862401.537954:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a65091a1800 from 1 10000000:01000000:1.0:1787862401.537957:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787862401.537986:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.538001:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.538010:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862401.538025:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349184:0@lo:101: 00000100:00100000:1.0:1787862401.538096:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.538124:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e64aeb23 going to sleep for 11 seconds 00000100:00100000:2.0:1787862401.538313:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349184 00000100:00100000:2.0:1787862401.538318:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349184 00000100:00100000:2.0:1787862401.538351:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787862401.538357:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ee43671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:5796:x1874709526349184:12345-0@lo:101: 00010000:00010000:2.0:1787862401.538367:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862401.538380:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fa10 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.538400:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.538409:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.538416:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e3a4b29, rc 0) 00000100:00100000:2.0:1787862401.538447:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ee43671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:5796:x1874709526349184:12345-0@lo:101: Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.538453:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787862401.538555:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349184:0@lo:101: 00010000:00010000:1.0:1787862401.538566:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.538574:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862401.539163:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349312:0@lo:256: 00000100:00100000:1.0:1787862401.539297:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.539318:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e64aeb23 going to sleep for 11 seconds 00000100:00100000:1.0:1787862401.539337:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349312 00000100:00100000:1.0:1787862401.539342:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349312 00000100:00100000:1.0:1787862401.539416:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787862401.539423:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b53df2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:5796:x1874709526349312:12345-0@lo:256: 20000000:01000000:1.0:1787862401.539436:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787862401.539441:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787862401.539496:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b53df2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:5796:x1874709526349312:12345-0@lo:256: Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862401.539511:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787862401.539679:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349312:0@lo:256: 10000000:01000000:1.0:1787862401.540322:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787862401.540383:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.540394:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862401.540401:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a65091a1800 from 1 10000000:01000000:1.0:1787862401.540404:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862401.540427:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.540432:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.540439:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862401.540451:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349440:0@lo:101: 00000100:00100000:1.0:1787862401.540483:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.540513:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e64aeb23 going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.540571:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349440 00000100:00100000:0.0:1787862401.540576:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349440 00000100:00100000:0.0:1787862401.540608:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862401.540613:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b5b787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:5796:x1874709526349440:12345-0@lo:101: 00010000:00010000:0.0:1787862401.540623:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862401.540633:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fa1e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.540660:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.540668:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.540676:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008883b2b9, rc 0) 00000100:00100000:0.0:1787862401.540701:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b5b787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5796:x1874709526349440:12345-0@lo:101: Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862401.540706:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862401.540842:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349440:0@lo:101: 00010000:00010000:1.0:1787862401.540852:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.540859:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862401.540916:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349568:0@lo:501: 00000100:00100000:1.0:1787862401.540937:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.540986:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e64aeb23 going to sleep for 11 seconds 00000100:00100000:0.0:1787862401.541231:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349568 00000100:00100000:0.0:1787862401.541236:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349568 00000100:00100000:2.0:1787862401.541314:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862401.541321:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054af9c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5796:x1874709526349568:12345-0@lo:501: 00000100:00100000:2.0:1787862401.541875:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054af9c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5796:x1874709526349568:12345-0@lo:501: Request processed in 555us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.541883:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862401.541981:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005a8afe8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349568:0@lo:501: 00000100:00100000:0.0:1787862401.542011:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349696:0@lo:503: 00000100:00100000:0.0:1787862401.542061:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.542079:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0e6957e going to sleep for 11 seconds 00000100:00100000:2.0:1787862401.542149:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349696 00000100:00100000:2.0:1787862401.542153:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349696 00000100:00100000:2.0:1787862401.542166:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862401.542176:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052f980b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5796:x1874709526349696:12345-0@lo:503: 00000040:00080000:2.0:1787862401.542216:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862401.542250:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052f980b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5796:x1874709526349696:12345-0@lo:503: Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.542257:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862401.542369:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349696:0@lo:503: 00000040:00080000:1.0:1787862401.543296:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787862401.543444:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787862401.543462:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862401.543480:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.543490:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862401.543530:0:5796:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787862401.543532:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a65091a1800 10000000:01000000:0.0:1787862401.543542:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a65091a1800 10000000:01000000:0.0:1787862401.543545:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862401.543550:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a65091a1800 from 1 10000000:01000000:0.0:1787862401.543553:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787862401.543577:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.543583:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.543591:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862401.543604:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349824:0@lo:101: 00000100:00100000:0.0:1787862401.543642:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.543667:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000509dbd27 going to sleep for 11 seconds 00000100:00100000:2.0:1787862401.543731:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349824 00000100:00100000:2.0:1787862401.543736:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349824 00000100:00100000:2.0:1787862401.543759:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862401.543765:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c202a37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5796:x1874709526349824:12345-0@lo:101: 00010000:00010000:2.0:1787862401.543775:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862401.543785:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ace30b9/0x9c5536ccf892fa33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fa2c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.543803:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ace30b9/0x9c5536ccf892fa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.543812:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ace30b9/0x9c5536ccf892fa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862401.543819:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ace30b9, rc 0) 00000100:00100000:2.0:1787862401.543846:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c202a37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526349824:12345-0@lo:101: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.543851:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862401.543929:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349824:0@lo:101: 00010000:00010000:0.0:1787862401.543940:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862401.543947:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862401.543984:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349952:0@lo:501: 00000100:00100000:0.0:1787862401.544005:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.544024:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000509dbd27 going to sleep for 11 seconds 00000100:00100000:2.0:1787862401.544140:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526349952 00000100:00100000:2.0:1787862401.544144:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526349952 00000100:00100000:2.0:1787862401.544164:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862401.544169:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ae83fcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526349952:12345-0@lo:501: 00000100:00100000:2.0:1787862401.544372:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ae83fcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526349952:12345-0@lo:501: Request processed in 203us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.544383:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862401.544496:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526349952:0@lo:501: 00000100:00100000:0.0:1787862401.544519:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526350080:0@lo:503: 00000100:00100000:0.0:1787862401.544559:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.544586:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000509dbd27 going to sleep for 11 seconds 00000100:00100000:1.0:1787862401.544634:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350080 00000100:00100000:1.0:1787862401.544638:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350080 00000100:00100000:1.0:1787862401.544667:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862401.544673:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bbb38d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526350080:12345-0@lo:503: 00000100:00100000:1.0:1787862401.545100:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bbb38d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526350080:12345-0@lo:503: Request processed in 427us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862401.545107:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862401.545305:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526350080:0@lo:503: 00000100:00100000:0.0:1787862401.545727:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5843:1874709526350208:0@lo:502: 00000100:00100000:0.0:1787862401.545770:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862401.545830:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049a42f5f going to sleep for 11 seconds 00000100:00100000:2.0:1787862401.545868:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350208 00000100:00100000:2.0:1787862401.545873:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350208 00000100:00100000:2.0:1787862401.546011:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862401.546020:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3fd9b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5843:x1874709526350208:12345-0@lo:502: 00000100:00100000:2.0:1787862401.546419:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3fd9b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5843:x1874709526350208:12345-0@lo:502: Request processed in 402us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.546427:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862401.546500:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000701f6615 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5843:1874709526350208:0@lo:502: 00000020:01000004:0.0:1787862401.546558:0:5843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787862401.546571:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001fc0ea9f) 00000020:00000080:0.0:1787862401.546590:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787862401.546680:0:5843:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000195c065e from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787862401.546684:0:5843:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000195c065e from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787862401.546686:0:5843:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000195c065e 4 00010000:00080000:0.0:1787862401.546722:0:5843:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e2a18864@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:0.0:1787862401.548355:0:5843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787862401.551166:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787862401.555038:0:5843:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787862401.555074:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c5536ccf892fa41 00000100:00080000:1.0:1787862401.555085:0:5843:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787862401.555090:0:5843:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e2a18864 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862401.555128:0:5843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000836422c9 x1874709526350336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862401.555163:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000836422c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526350336:0@lo:38: 00000100:00100000:1.0:1787862401.555250:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787862401.555318:0:5843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787862401.555433:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350336 00000100:00100000:0.0:1787862401.555441:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350336 00000100:00100000:0.0:1787862401.555479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862401.555486:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5022904 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526350336:12345-0@lo:38: 00000100:00100000:0.0:1787862401.555538:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5022904 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526350336:12345-0@lo:38: Request processed in 52us (288us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787862401.555544:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862401.555612:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787862401.555619:0:3280:0:(import.c:65:import_set_state_nolock()) 00000000e2a18864 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862401.555623:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787862401.555626:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000836422c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526350336:0@lo:38: 00000100:00100000:2.0:1787862401.556080:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5843:1874709526350464:0@lo:502: 00000100:00100000:2.0:1787862401.556123:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862401.556145:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4cdfdcc going to sleep for 11 seconds 00000100:00100000:1.0:1787862401.556200:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350464 00000100:00100000:1.0:1787862401.556210:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350464 00000100:00100000:1.0:1787862401.556244:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862401.556249:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9091aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5843:x1874709526350464:12345-0@lo:502: 00000100:00100000:1.0:1787862401.556448:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9091aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5843:x1874709526350464:12345-0@lo:502: Request processed in 199us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862401.556456:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862401.556586:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:5843:1874709526350464:0@lo:502: 00000040:00080000:2.0:1787862401.556610:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787862401.556713:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787862401.556734:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787862401.556751:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.556760:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 00000000acafc027/0x9c5536ccf892fa2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787862401.556800:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787862401.556802:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862401.556803:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862401.556804:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862401.556805:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862401.556807:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862401.556808:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862401.556810:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862401.556812:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862401.556813:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862401.556816:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862401.556817:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787862401.556820:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787862401.556822:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787862401.556823:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787862401.556824:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862401.556825:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862401.556826:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862401.556827:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862401.556828:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787862401.556829:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787862401.556832:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862401.556833:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862401.556834:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862401.556835:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787862401.556847:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787862401.556854:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000836422c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526350592:0@lo:253: 00000100:00100000:1.0:1787862401.556882:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.556965:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc7a5e7a going to sleep for 11 seconds 00000100:00100000:2.0:1787862401.557038:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350592 00000100:00100000:2.0:1787862401.557082:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350592 00000100:00100000:2.0:1787862401.557107:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862401.557112:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035e18cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526350592:12345-0@lo:253: 20000000:01000000:2.0:1787862401.557130:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787862401.557141:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1787862401.564451:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1787862401.580451:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787862401.580499:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787862401.585076:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787862401.585088:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787862401.585108:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.585126:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.585134:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.585173:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.585185:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862401.585209:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4a221f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874709526350720:0@lo:104: 00000100:00100000:1.0:1787862401.585277:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.585330:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1d0c97f going to sleep for 11 seconds 00000100:00100000:3.0:1787862401.585546:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350720 00000100:00100000:3.0:1787862401.585553:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350720 00000100:00100000:3.0:1787862401.585643:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862401.585651:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc1d88e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5831:x1874709526350720:12345-0@lo:104: 00010000:00010000:3.0:1787862401.585664:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862401.585727:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862401.585733:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc1d88e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5831:x1874709526350720:12345-0@lo:104: Request processed in 83us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862401.585740:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862401.585863:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4a221f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874709526350720:0@lo:104: 00010000:00010000:2.0:1787862401.585880:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862401.586357:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035e18cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5796:x1874709526350592:12345-0@lo:253: Request processed in 29244us (29474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862401.586381:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787862401.586461:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000836422c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:5796:1874709526350592:0@lo:253: 10000000:01000000:0.0:1787862401.586473:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787862401.586476:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862401.586478:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787862401.586485:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862401.586486:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862401.586488:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862401.586489:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862401.586490:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787862401.586491:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787862401.586492:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787862401.586494:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787862401.586495:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862401.586496:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787862401.586507:0:5796:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787862401.589009:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862401.589021:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589066:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000480f9092 already unused, calling callback (000000007f926af8) 10000000:00010000:1.0:1787862401.589069:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589077:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862401.589084:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862401.589088:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862401.589133:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589139:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862401.589158:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589164:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: 00000000480f9092/0x9c5536ccf892fa10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa17 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589195:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862401.589197:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862401.589199:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862401.589313:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b52f4e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526350848:0@lo:103: 00000100:00100000:1.0:1787862401.589375:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862401.589475:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350848 00000100:00100000:1.0:1787862401.589483:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350848 00010000:00010000:1.0:1787862401.589508:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862401.589544:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862401.589552:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1cc2617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3282:x1874709526350848:12345-0@lo:103: 00010000:00010000:1.0:1787862401.589564:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862401.589568:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589577:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589590:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e3a4b29/0x9c5536ccf892fa17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fa10 expref: 12 pid: 5809 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589605:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589612:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787862401.589630:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004542042s 00010000:00010000:1.0:1787862401.589633:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589639:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589644:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589649:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589660:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd412118 already unused, calling callback (00000000cf3a3f32) 00010000:00010000:1.0:1787862401.589663:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589669:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589684:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589694:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862401.589727:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1cc2617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:3282:x1874709526350848:12345-0@lo:103: Request processed in 176us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862401.589734:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862401.589781:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b52f4e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526350848:0@lo:103: 00010000:00010000:1.0:1787862401.589804:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589811:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862401.589817:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd412118/0x9c5536ccf892fa48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787862401.592360:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862401.592698:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862401.592912:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862401.593113:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862401.593322:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862401.593496:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787862401.595301:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862401.595512:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787862401.595705:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787862401.595880:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862401.596486:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862401.596651:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787862401.637642:0:5796:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787862401.667234:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787862401.667528:0:5849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787862401.669593:0:5848:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787862401.669602:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787862401.674604:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787862401.678690:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787862401.679201:0:5796:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787862401.679217:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787862401.679447:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862401.685241:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787862401.685783:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787862401.685816:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787862401.686225:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787862401.686408:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787862401.688382:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787862401.688532:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787862401.688686:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787862401.688820:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787862401.689421:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787862401.689564:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787862401.689727:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787862401.689863:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787862401.690114:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787862401.690251:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787862401.690406:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787862401.690563:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787862401.690747:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787862401.690871:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787862401.691279:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787862401.691411:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787862401.691711:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787862401.691851:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787862401.692453:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787862401.692580:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787862401.692707:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787862401.692846:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787862401.693245:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787862401.693397:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787862401.693556:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787862401.693688:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787862401.693855:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787862401.694283:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787862401.694441:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787862401.694580:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787862401.694729:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787862401.694875:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787862401.699843:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787862401.726607:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787862401.765168:0:5796:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787862401.765219:0:5796:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf1501c7f988 00100000:10000000:3.0:1787862401.765227:0:5796:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787862401.766150:0:5796:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787862401.766165:0:5796:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787862401.766178:0:5796:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787862401.766217:0:5796:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787862401.807922:0:5849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787862401.808009:0:5849:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787862401.808014:0:5849:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787862402.588318:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862403.612199:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862404.636232:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862405.660308:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862406.684694:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787862406.812218:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787862406.812227:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787862406.812230:0:471:0:(import.c:65:import_set_state_nolock()) 00000000e2a18864 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787862406.812242:0:471:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e2a18864 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862406.812266:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a4844081 x1874709526351104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862406.812282:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f300b1cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526350976:0@lo:400: 00000100:00100000:2.0:1787862406.812298:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526351104:0@lo:38: 00000100:00100000:2.0:1787862406.816108:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862406.816408:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351104 00000100:00100000:3.0:1787862406.816420:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351104 00000100:00100000:3.0:1787862406.816455:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862406.816462:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099ccae69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526351104:12345-0@lo:38: 00010000:00080000:3.0:1787862406.816494:0:5817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:3.0:1787862406.816627:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c5536ccf892fa4f 00000004:00100000:3.0:1787862406.816675:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787862406.816816:0:5817:0:(import.c:65:import_set_state_nolock()) 0000000098621868 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862406.816887:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099ccae69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874709526351104:12345-0@lo:38: Request processed in 424us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862406.816896:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787862406.816953:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a4844081 x1874709526351104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787862406.816971:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787862406.816979:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787862406.816984:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787862406.816986:0:3280:0:(import.c:65:import_set_state_nolock()) 00000000e2a18864 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787862406.816991:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526351104:0@lo:38: 00000100:00100000:0.0:1787862406.818887:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862406.819193:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526350976 00000100:00100000:3.0:1787862406.819203:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526350976 00000100:00100000:3.0:1787862406.819255:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787862406.819265:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088a9abfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:3283:x1874709526350976:12345-0@lo:400: 00000100:00100000:3.0:1787862406.819321:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088a9abfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:3283:x1874709526350976:12345-0@lo:400: Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862406.820062:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f300b1cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526350976:0@lo:400: 00000100:00100000:3.0:1787862406.820149:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000001:02000400:2.0:1787862407.048512:0:6092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787862407.708240:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862408.349646:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787862408.349659:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a65091a1800 from 3 10000000:01000000:2.0:1787862408.349664:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862408.349704:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.349716:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.349727:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862408.349748:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de17d397 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526351232:0@lo:101: 00000100:00100000:2.0:1787862408.349819:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862408.349878:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080c23f54 going to sleep for 11 seconds 00000100:00100000:2.0:1787862408.349900:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351232 00000100:00100000:2.0:1787862408.349907:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351232 00000100:00100000:2.0:1787862408.349953:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862408.349961:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b84166e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5813:x1874709526351232:12345-0@lo:101: 00010000:00010000:2.0:1787862408.349973:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862408.349983:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032735ff1/0x9c5536ccf892fa5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fa56 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.350004:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032735ff1/0x9c5536ccf892fa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.350016:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032735ff1/0x9c5536ccf892fa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.350024:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032735ff1, rc 0) 00000100:00100000:2.0:1787862408.350093:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b84166e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526351232:12345-0@lo:101: Request processed in 133us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862408.350105:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862408.350175:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de17d397 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526351232:0@lo:101: 00010000:00010000:2.0:1787862408.350190:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.350198:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862408.350245:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de17d397 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526351360:0@lo:256: 00000100:00100000:2.0:1787862408.350274:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862408.350295:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080c23f54 going to sleep for 11 seconds 00000100:00100000:2.0:1787862408.350308:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351360 00000100:00100000:2.0:1787862408.350312:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351360 00000100:00100000:2.0:1787862408.350333:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862408.350339:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000736266d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526351360:12345-0@lo:256: 20000000:01000000:2.0:1787862408.350352:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787862408.350369:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787862408.350372:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787862408.350446:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000736266d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526351360:12345-0@lo:256: Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862408.350453:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862408.350481:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de17d397 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526351360:0@lo:256: 10000000:01000000:2.0:1787862408.350518:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862408.350524:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862408.350531:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: 000000007dfc7a7e/0x9c5536ccf892fa56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862408.733499:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862409.759706:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862410.788200:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862411.804625:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862411.949420:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862411.949449:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031d5d9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526351488:0@lo:400: 00000100:00100000:1.0:1787862411.949522:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862411.949923:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e56ee137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526351616:0@lo:400: 00000100:00100000:1.0:1787862411.949957:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862411.950650:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351488 00000100:00100000:2.0:1787862411.950660:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351488 00000100:00100000:2.0:1787862411.950708:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862411.950716:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003de55a09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3283:x1874709526351488:12345-0@lo:400: 00000100:00100000:2.0:1787862411.950786:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003de55a09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3283:x1874709526351488:12345-0@lo:400: Request processed in 71us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862411.950805:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862411.950992:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031d5d9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526351488:0@lo:400: 00000100:00100000:0.0:1787862411.953701:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351616 00000100:00100000:0.0:1787862411.953716:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351616 00000100:00100000:0.0:1787862411.953773:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862411.953781:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000378e9691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526351616:12345-0@lo:400: 00000100:00100000:0.0:1787862411.954038:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000378e9691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526351616:12345-0@lo:400: Request processed in 257us (4080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862411.954071:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787862411.954199:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e56ee137 x1874709526351616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862411.954214:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e56ee137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526351616:0@lo:400: 00000020:00000080:1.0:1787862412.191710:0:6294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecf2499b0 20000000:00000080:1.0:1787862412.191728:0:6294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a65063eb400 uarg=0000000000000000 20000000:01000000:1.0:1787862412.191760:0:6294:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787862412.191768:0:6294:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787862412.191772:0:6294:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787862412.192208:0:6294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787862412.192221:0:6294:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787862412.195890:0:6294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862412.196394:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787862412.196460:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787862412.196512:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787862412.196529:0:6294:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787862412.196547:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.196564:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.196571:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.196617:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.196631:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 11 pid: 5809 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862412.196644:0:6294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031d5d9d3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6294:1874709526351744:0@lo:104: 00000100:00100000:1.0:1787862412.196710:0:6294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862412.196768:0:6294:0:(client.c:2715:ptlrpc_set_wait()) set 00000000760a9901 going to sleep for 11 seconds 00000100:00100000:3.0:1787862412.196873:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351744 00000100:00100000:3.0:1787862412.196881:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351744 00000100:00100000:3.0:1787862412.196926:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862412.196933:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f91a7735 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:6294:x1874709526351744:12345-0@lo:104: 00010000:00010000:3.0:1787862412.196944:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.196995:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862412.197005:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f91a7735 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:6294:x1874709526351744:12345-0@lo:104: Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862412.197012:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787862412.197029:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862412.197033:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197061:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005422dbe9 already unused, calling callback (000000007f926af8) 10000000:00010000:3.0:1787862412.197064:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197072:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862412.197078:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862412.197083:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862412.197124:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197131:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862412.197148:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197154:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: 000000005422dbe9/0x9c5536ccf892fa1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa25 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197174:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862412.197176:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862412.197177:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862412.197198:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079c71a6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526351872:0@lo:103: 00000100:00100000:3.0:1787862412.197225:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862412.197262:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526351872 00000100:00100000:3.0:1787862412.197265:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526351872 00010000:00010000:3.0:1787862412.197278:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 12 pid: 5809 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862412.197299:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862412.197303:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e4a84ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3282:x1874709526351872:12345-0@lo:103: 00010000:00010000:3.0:1787862412.197312:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862412.197316:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 12 pid: 5809 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197325:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 12 pid: 5809 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197339:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197346:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197358:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197364:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197370:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197385:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197391:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000056fd0b4d already unused, calling callback (00000000cf3a3f32) 00010000:00010000:3.0:1787862412.197393:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197400:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197408:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862412.197418:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862412.197446:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e4a84ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3282:x1874709526351872:12345-0@lo:103: Request processed in 141us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862412.197453:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862412.197489:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079c71a6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526351872:0@lo:103: 00010000:00010000:1.0:1787862412.197605:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008883b2b9/0x9c5536ccf892fa25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fa1e expref: 11 pid: 5809 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862412.197613:0:6294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031d5d9d3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6294:1874709526351744:0@lo:104: 00010000:00010000:1.0:1787862412.197621:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.197627:0:6294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.197630:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.197633:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000056fd0b4d/0x9c5536ccf892fa64 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862412.837104:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862413.852992:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862414.878668:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862415.901361:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862416.926003:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862417.052955:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002573331d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526352128:0@lo:400: 00000100:00100000:0.0:1787862417.053030:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862417.053116:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862417.053122:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059c30087 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526352000:0@lo:400: 00000100:00100000:0.0:1787862417.053153:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862417.053185:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352000 00000100:00100000:0.0:1787862417.053192:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352000 00000100:00100000:0.0:1787862417.053233:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862417.053240:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a415d1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:3284:x1874709526352000:12345-0@lo:400: 00000100:00100000:0.0:1787862417.053280:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a415d1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:3284:x1874709526352000:12345-0@lo:400: Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862417.053288:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862417.053341:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059c30087 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526352000:0@lo:400: 00000100:00100000:3.0:1787862417.053471:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352128 00000100:00100000:3.0:1787862417.053475:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352128 00000100:00100000:3.0:1787862417.053511:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862417.053517:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701f6615 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526352128:12345-0@lo:400: 00000100:00100000:3.0:1787862417.053567:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701f6615 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526352128:12345-0@lo:400: Request processed in 51us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862417.053574:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787862417.054128:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002573331d x1874709526352128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862417.054151:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002573331d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526352128:0@lo:400: 00010000:00010000:0.0:1787862417.954894:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862418.588166:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862418.588174:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a65091a1800 from 1 10000000:01000000:2.0:1787862418.588179:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862418.588217:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: 00000000579e121f/0x9c5536ccf892fa6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862418.588229:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: 00000000579e121f/0x9c5536ccf892fa6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862418.588238:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: 00000000579e121f/0x9c5536ccf892fa6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862418.588258:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526352256:0@lo:101: 00000100:00100000:2.0:1787862418.588323:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862418.588371:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b4d95df9 going to sleep for 11 seconds 00000100:00100000:3.0:1787862418.588417:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352256 00000100:00100000:3.0:1787862418.588424:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352256 00000100:00100000:3.0:1787862418.588466:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787862418.588473:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aefb7bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:5813:x1874709526352256:12345-0@lo:101: 00010000:00010000:3.0:1787862418.588485:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862418.588497:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd4ed1f7/0x9c5536ccf892fa72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fa6b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.588517:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd4ed1f7/0x9c5536ccf892fa72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.588527:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd4ed1f7/0x9c5536ccf892fa72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.588536:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd4ed1f7, rc 0) 00000100:00100000:3.0:1787862418.588570:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aefb7bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526352256:12345-0@lo:101: Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862418.588576:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787862418.588614:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4844081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526352256:0@lo:101: 00010000:00010000:3.0:1787862418.588625:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: 00000000579e121f/0x9c5536ccf892fa6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.588632:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: 00000000579e121f/0x9c5536ccf892fa6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862418.588677:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc57904b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526352384:0@lo:501: 00000100:00100000:3.0:1787862418.588713:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862418.588725:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d3a940c going to sleep for 11 seconds 00000100:00100000:3.0:1787862418.588746:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352384 00000100:00100000:3.0:1787862418.588749:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352384 00000100:00100000:3.0:1787862418.588766:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862418.588771:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006324bb82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526352384:12345-0@lo:501: 00000100:00100000:3.0:1787862418.588978:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006324bb82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526352384:12345-0@lo:501: Request processed in 207us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862418.588985:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862418.589014:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc57904b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526352384:0@lo:501: 00000100:00100000:3.0:1787862418.589070:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc57904b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526352512:0@lo:503: 00000100:00100000:3.0:1787862418.589102:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862418.589119:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d3a940c going to sleep for 11 seconds 00000100:00100000:3.0:1787862418.589127:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352512 00000100:00100000:3.0:1787862418.589130:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352512 00000100:00100000:3.0:1787862418.589145:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862418.589149:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c99a9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526352512:12345-0@lo:503: 00000100:00100000:3.0:1787862418.589330:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c99a9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526352512:12345-0@lo:503: Request processed in 180us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862418.589337:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862418.589366:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc57904b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526352512:0@lo:503: 00000100:00100000:3.0:1787862418.589508:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc57904b pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6668:1874709526352640:0@lo:502: 00000100:00100000:3.0:1787862418.589535:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862418.589550:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352640 00000100:00100000:3.0:1787862418.589552:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352640 00000100:00100000:3.0:1787862418.589568:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862418.589577:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5bca9fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6668:x1874709526352640:12345-0@lo:502: 00000100:00100000:3.0:1787862418.589683:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5bca9fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6668:x1874709526352640:12345-0@lo:502: Request processed in 105us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862418.589689:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862418.589715:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d67ba60 going to sleep for 11 seconds 00000100:00100000:3.0:1787862418.589726:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc57904b pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6668:1874709526352640:0@lo:502: 00000020:01000000:3.0:1787862418.589744:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862418.589752:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862418.589755:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787862418.589761:0:6668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a65091a1800 00000020:00000080:3.0:1787862418.589763:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787862418.589798:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6668:1874709526352768:0@lo:502: 00000100:00100000:3.0:1787862418.589831:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862418.589849:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352768 00000100:00100000:3.0:1787862418.589852:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352768 00000100:00100000:3.0:1787862418.589871:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862418.589876:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6668:x1874709526352768:12345-0@lo:502: 00000100:00100000:3.0:1787862418.589967:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6668:x1874709526352768:12345-0@lo:502: Request processed in 89us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862418.589973:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862418.589998:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862418.590009:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6668:1874709526352768:0@lo:502: 00000020:01000000:3.0:1787862418.590025:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862418.590062:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862418.590065:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787862418.590069:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787862418.590129:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787862418.590150:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862418.590159:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862418.590168:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787862418.780840:0:6666:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787862418.780844:0:6666:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787862418.781314:0:6666:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a653d6d2000 00000020:01000004:3.0:1787862418.781333:0:6666:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787862418.781346:0:6666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787862418.781363:0:6666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a653aa28000) 00000020:00000080:3.0:1787862418.781385:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787862418.797673:0:6666:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787862418.798227:0:6666:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787862418.820888:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787862418.827439:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787862418.827472:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787862418.827523:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787862418.827546:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787862418.827972:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787862418.827983:0:6666:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787862418.828169:0:6666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c5536ccf892fa80 00000020:01000004:1.0:1787862418.828177:0:6666:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787862418.828196:0:6666:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787862418.828200:0:6666:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787862418.828205:0:6666:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787862418.828209:0:6666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787862418.828228:0:6666:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a6526ce1a48) 00000020:00000080:1.0:1787862418.828239:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787862418.831508:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862418.831699:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862418.831705:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787862418.840885:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787862418.840900:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787862418.841905:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862418.841916:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787862418.843660:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862418.843858:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787862418.843863:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787862418.844741:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787862418.844750:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787862418.875881:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862418.876400:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862418.876407:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787862418.879216:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787862418.879230:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787862418.881314:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787862418.881330:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787862418.892982:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862418.894342:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787862418.894350:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787862418.897389:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787862418.897402:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787862418.964664:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862418.965433:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787862418.965442:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787862418.967447:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787862418.967460:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787862418.967868:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787862418.967891:0:6666:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787862418.967898:0:6666:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:1.0:1787862418.975847:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787862418.993452:0:6666:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787862418.993490:0:6666:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787862418.993494:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787862418.993495:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862418.993496:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862418.993497:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862418.993498:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862418.993499:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862418.993500:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862418.993501:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862418.993502:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862418.993503:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862418.993504:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862418.993508:0:6666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787862418.993509:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862418.993510:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862418.993511:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862418.993511:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862418.993512:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862418.993513:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862418.993513:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862418.993514:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862418.993514:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862418.993515:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862418.993516:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862418.993540:0:6666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787862418.993559:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526352896:0@lo:253: 00000100:00100000:2.0:1787862418.993622:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862418.993730:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650adcf240 going to sleep for 11 seconds 00000100:00100000:3.0:1787862418.993767:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526352896 00000100:00100000:3.0:1787862418.993774:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526352896 00000100:00100000:3.0:1787862418.993816:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862418.993823:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526352896:12345-0@lo:253: 20000000:01000000:3.0:1787862418.993847:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787862418.993851:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787862418.993855:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787862418.993858:0:5810:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787862418.995267:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862418.995462:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787862418.995474:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787862418.995500:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787862418.995505:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787862418.995532:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787862418.995561:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787862418.995811:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787862418.995830:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:3.0:1787862418.995831:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:3.0:1787862418.995852:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787862418.995857:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787862418.995891:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787862418.995897:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:3.0:1787862418.995915:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787862418.995920:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787862418.995935:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787862418.995960:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787862418.996596:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787862418.996609:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:3.0:1787862418.996610:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:3.0:1787862418.996631:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787862418.996638:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787862418.996667:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787862418.996675:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:3.0:1787862418.996720:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787862418.996730:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787862418.996762:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787862418.996796:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787862418.996811:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787862418.996814:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787862418.996818:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787862418.996819:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787862418.996821:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787862418.996831:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787862418.996833:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787862418.996854:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787862418.996856:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787862418.997490:0:6682:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787862418.997527:0:6682:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787862418.997557:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787862418.997806:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787862418.997829:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787862418.997879:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787862418.997887:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787862418.997888:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787862418.998304:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787862418.998512:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787862418.998546:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787862418.998580:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787862418.998588:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787862418.998589:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862418.998946:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862418.998975:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862418.999011:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787862418.999650:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787862418.999675:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787862418.999702:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1787862418.999719:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787862418.999739:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862418.999756:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862418.999763:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862418.999771:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862418.999777:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862418.999814:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862418.999841:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 12 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862418.999856:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0bc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526353024:0@lo:104: 00000100:00100000:0.0:1787862418.999917:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862419.000012:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.000021:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 12 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.000040:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526353152:0@lo:104: 00000100:00100000:0.0:1787862419.000097:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862419.000336:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.000344:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 12 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.000352:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526353280:0@lo:104: 00000100:00100000:0.0:1787862419.000373:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.000393:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353024 00000100:00100000:1.0:1787862419.000399:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353024 00000100:00100000:0.0:1787862419.000484:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f540 going to sleep for 10 seconds 00000100:00100000:3.0:1787862419.000507:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353152 00000100:00100000:3.0:1787862419.000510:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353152 00000100:00100000:3.0:1787862419.000523:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353280 00000100:00100000:3.0:1787862419.000524:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353280 00000100:00100000:3.0:1787862419.000533:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.000539:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5810:x1874709526353024:12345-0@lo:104: 00010000:00010000:3.0:1787862419.000547:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000595:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862419.000598:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5810:x1874709526353024:12345-0@lo:104: Request processed in 61us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.000603:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.000615:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862419.000619:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:5810:x1874709526353152:12345-0@lo:104: 00010000:00010000:3.0:1787862419.000623:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000654:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787862419.000664:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:5810:x1874709526353152:12345-0@lo:104: Request processed in 45us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.000670:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862419.000684:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862419.000689:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5810:x1874709526353280:12345-0@lo:104: 00010000:00010000:3.0:1787862419.000696:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000721:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787862419.000726:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5810:x1874709526353280:12345-0@lo:104: Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.000732:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787862419.000749:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787862419.000754:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000762:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031c00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862419.000766:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000774:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862419.000782:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862419.000786:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862419.000809:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000822:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862419.000835:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000839:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6500031c00/0x9c5536ccf892fa2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa33 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000848:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862419.000850:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000853:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862419.000855:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000859:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862419.000862:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862419.000865:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862419.000872:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000875:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862419.000877:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000880:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892f9bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892f9c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000893:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862419.000895:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000899:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862419.000901:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000904:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862419.000907:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862419.000910:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862419.000916:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000919:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862419.000928:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000931:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd200/0x9c5536ccf892f9a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892f9a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.000940:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862419.000941:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862419.000942:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862419.000956:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526353408:0@lo:103: 00000100:00100000:3.0:1787862419.000979:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.000998:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862419.001003:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526353536:0@lo:103: 00000100:00100000:3.0:1787862419.001021:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.001081:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526353664:0@lo:103: 00000100:00100000:3.0:1787862419.001097:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.001118:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353408 00000100:00100000:3.0:1787862419.001121:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353408 00010000:00010000:3.0:1787862419.001133:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 13 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.001143:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353536 00000100:00100000:3.0:1787862419.001144:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353536 00010000:00010000:3.0:1787862419.001149:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 14 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.001154:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353664 00000100:00100000:3.0:1787862419.001156:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353664 00010000:00010000:3.0:1787862419.001160:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 15 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.001167:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.001170:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:3281:x1874709526353408:12345-0@lo:103: 00010000:00010000:3.0:1787862419.001178:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862419.001182:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 15 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001192:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 15 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001215:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862419.001241:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:3281:x1874709526353408:12345-0@lo:103: Request processed in 69us (260us total) trans 0 rc 0/0 00010000:00010000:2.0:1787862419.001344:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862419.001392:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.001406:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862419.001413:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3281:x1874709526353536:12345-0@lo:103: 00010000:00010000:3.0:1787862419.001421:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862419.001424:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 14 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001433:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 14 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001441:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862419.001463:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3281:x1874709526353536:12345-0@lo:103: Request processed in 51us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.001468:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862419.001479:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862419.001485:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3283:x1874709526353664:12345-0@lo:103: 00010000:00010000:3.0:1787862419.001491:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862419.001495:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 13 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001503:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 13 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001514:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001529:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001544:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001550:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001555:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001561:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001567:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862419.001571:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001578:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001587:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.001596:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862419.001701:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfda00/0x9c5536ccf892fa33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fa2c expref: 13 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.001714:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0bc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526353024:0@lo:104: 00010000:00010000:0.0:1787862419.001725:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45400/0x9c5536ccf892f9c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892f9bc expref: 12 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.001745:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526353152:0@lo:104: 00010000:00010000:0.0:1787862419.001756:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500030600/0x9c5536ccf892f9a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892f9a0 expref: 11 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.001764:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526353280:0@lo:104: 00010000:00010000:0.0:1787862419.001786:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.001795:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.001802:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.001808:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fa8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787862419.001819:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787862419.001875:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:3283:x1874709526353664:12345-0@lo:103: Request processed in 391us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.001880:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862419.001921:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526353536:0@lo:103: 00000100:00100000:3.0:1787862419.001931:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526353408:0@lo:103: 00000100:00100000:2.0:1787862419.004739:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526353664:0@lo:103: 00000100:00100000:3.0:1787862419.038598:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:6666:x1874709526352896:12345-0@lo:253: Request processed in 44767us (44967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.038612:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787862419.038736:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526352896:0@lo:253: 10000000:01000000:0.0:1787862419.038753:0:6666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787862419.038756:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862419.038758:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862419.038760:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862419.038761:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787862419.038762:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862419.038763:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862419.038764:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862419.038766:0:6666:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787862419.038768:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862419.038769:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787862419.038806:0:6666:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a653d6d2000 from lustre-OST0000 10000000:01000000:0.0:1787862419.038828:0:6666:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787862419.038830:0:6666:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787862419.038837:0:6666:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a653aa2b490 local copy 10000000:01000000:0.0:1787862419.038842:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787862419.038873:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.038884:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.038892:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.038909:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526353792:0@lo:101: 00000100:00100000:0.0:1787862419.038944:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862419.039231:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862419.039515:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353792 00000100:00100000:2.0:1787862419.039522:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353792 00000100:00100000:2.0:1787862419.039598:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862419.039607:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:6666:x1874709526353792:12345-0@lo:101: 00010000:00010000:2.0:1787862419.039620:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862419.039636:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fa95 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.039658:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fa95 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.039669:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa95 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.039678:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787862419.039728:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:6666:x1874709526353792:12345-0@lo:101: Request processed in 122us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862419.039735:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862419.039805:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526353792:0@lo:101: 00010000:00010000:1.0:1787862419.039820:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.039827:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862419.039930:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526353920:0@lo:501: 00000100:00100000:1.0:1787862419.039952:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.039970:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862419.039994:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526353920 00000100:00100000:3.0:1787862419.039999:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526353920 00000100:00100000:3.0:1787862419.040210:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787862419.040219:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:6666:x1874709526353920:12345-0@lo:501: 00000100:00100000:3.0:1787862419.040552:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:6666:x1874709526353920:12345-0@lo:501: Request processed in 334us (597us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862419.040560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787862419.040634:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526353920:0@lo:501: 10000000:01000000:1.0:1787862419.040647:0:6666:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787862419.040674:0:6666:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787862419.040680:0:6666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.040689:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.040695:0:6666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.040719:0:6666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862419.040740:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a653d6d2000 10000000:01000000:1.0:1787862419.040744:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787862419.040749:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a653aa2b490 10000000:01000000:1.0:1787862419.040751:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787862419.040755:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a653aa2b490 from 1 10000000:01000000:1.0:1787862419.040757:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787862419.040776:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.040784:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.040804:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862419.040817:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354048:0@lo:101: 00000100:00100000:1.0:1787862419.040843:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787862419.040883:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862419.040889:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.040915:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862419.040918:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.040926:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862419.040932:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862419.040938:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862419.040956:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.040962:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862419.040980:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.040998:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6500031800/0x9c5536ccf892fa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c5536ccf892fa9c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.041022:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862419.041032:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862419.041034:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862419.041072:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862419.041084:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526354176:0@lo:103: 00000100:00100000:2.0:1787862419.041113:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862419.041161:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354176 00000100:00100000:2.0:1787862419.041166:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354176 00000100:00100000:2.0:1787862419.041205:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862419.041212:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:3283:x1874709526354176:12345-0@lo:103: 00010000:00010000:2.0:1787862419.041222:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862419.041235:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fa9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fa95 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.041396:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862419.041427:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:3283:x1874709526354176:12345-0@lo:103: Request processed in 215us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862419.041434:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862419.041468:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526354176:0@lo:103: 00000100:00100000:1.0:1787862419.041861:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.041948:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354048 00000100:00100000:0.0:1787862419.041953:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354048 00000100:00100000:0.0:1787862419.041980:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787862419.041987:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+9:6666:x1874709526354048:12345-0@lo:101: 00010000:00010000:0.0:1787862419.041998:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862419.042022:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6500030600/0x9c5536ccf892faaa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892faa3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.042070:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500030600/0x9c5536ccf892faaa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892faa3 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.042080:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6500030600/0x9c5536ccf892faaa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892faa3 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.042111:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030600, rc 0) 00000100:00100000:0.0:1787862419.042157:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:6666:x1874709526354048:12345-0@lo:101: Request processed in 170us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.042163:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787862419.042406:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354048:0@lo:101: 00010000:00010000:1.0:1787862419.042420:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.042429:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862419.042446:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787862419.042458:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.042466:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862419.042473:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787862419.042478:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787862419.042483:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787862419.042486:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787862419.042505:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.042512:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.042528:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862419.042544:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354304:0@lo:101: 00000100:00100000:1.0:1787862419.042573:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.042593:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.042704:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354304 00000100:00100000:0.0:1787862419.042708:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354304 00000100:00100000:0.0:1787862419.042727:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787862419.042733:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+10:6666:x1874709526354304:12345-0@lo:101: 00010000:00010000:0.0:1787862419.042741:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862419.042749:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fab1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.042761:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.042769:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.042775:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787862419.042810:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354304:12345-0@lo:101: Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.042817:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862419.042891:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354304:0@lo:101: 00010000:00010000:1.0:1787862419.042899:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.042906:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862419.042982:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354432:0@lo:501: 00000100:00100000:1.0:1787862419.043006:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.043063:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.043446:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354432 00000100:00100000:0.0:1787862419.043455:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354432 00000100:00100000:0.0:1787862419.043476:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862419.043481:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354432:12345-0@lo:501: 00000100:00100000:0.0:1787862419.043695:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354432:12345-0@lo:501: Request processed in 213us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.043707:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787862419.043784:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354432:0@lo:501: 00000100:00100000:1.0:1787862419.043812:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354560:0@lo:503: 00000100:00100000:1.0:1787862419.043846:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.043872:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.043914:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354560 00000100:00100000:0.0:1787862419.043918:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354560 00000100:00100000:0.0:1787862419.043932:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862419.043937:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354560:12345-0@lo:503: 00000100:00100000:0.0:1787862419.044088:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354560:12345-0@lo:503: Request processed in 150us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.044094:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787862419.044164:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354560:0@lo:503: 00000040:00080000:1.0:1787862419.044409:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862419.044464:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354688:0@lo:502: 00000100:00100000:1.0:1787862419.044495:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.044522:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.044629:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354688 00000100:00100000:0.0:1787862419.044634:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354688 00000100:00100000:0.0:1787862419.044650:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787862419.044655:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354688:12345-0@lo:502: 00000100:00100000:0.0:1787862419.044772:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354688:12345-0@lo:502: Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.044778:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787862419.044933:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354688:0@lo:502: 00000040:00080000:1.0:1787862419.045173:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787862419.045213:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787862419.045238:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787862419.045289:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787862419.045320:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787862419.045351:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787862419.045372:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354816:0@lo:502: 00000100:00100000:1.0:1787862419.045402:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.045505:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862419.045625:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354816 00000100:00100000:3.0:1787862419.045629:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354816 00000100:00100000:3.0:1787862419.045651:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787862419.045657:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354816:12345-0@lo:502: 00000100:00100000:3.0:1787862419.045785:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354816:12345-0@lo:502: Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.045792:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787862419.045936:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354816:0@lo:502: 00000040:00080000:1.0:1787862419.046007:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787862419.046016:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787862419.046514:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787862419.046522:0:6685:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787862419.046529:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862419.046531:0:6685:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787862419.046535:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787862419.046550:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6526ce0000) 00000020:00000080:1.0:1787862419.046581:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787862419.046588:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787862419.046649:0:6685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a653d6d2000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787862419.046655:0:6685:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787862419.046661:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c5536ccf892fac6 00010000:00010000:1.0:1787862419.050717:0:6685:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787862419.051947:0:6685:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787862419.054630:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787862419.054948:0:6685:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787862419.061662:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787862419.062637:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787862419.064033:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787862419.064069:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862419.064076:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862419.064078:0:6685:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787862419.064082:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862419.064085:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862419.064087:0:6685:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787862419.064089:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787862419.064091:0:6685:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787862419.064141:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862419.064144:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862419.064146:0:6685:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787862419.064148:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787862419.064417:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787862419.064442:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787862419.064465:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.064477:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862419.064486:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a653d6d2000 from 1 10000000:01000000:0.0:1787862419.064490:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862419.064526:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.064544:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.064556:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862419.064580:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354944:0@lo:101: 00000100:00100000:0.0:1787862419.064652:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862419.064711:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862419.064778:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526354944 00000100:00100000:2.0:1787862419.064787:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526354944 00000100:00100000:2.0:1787862419.064839:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862419.064849:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:6666:x1874709526354944:12345-0@lo:101: 00010000:00010000:2.0:1787862419.064863:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862419.064877:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892facd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.064899:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892facd expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.064910:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892facd expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.064918:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787862419.064960:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526354944:12345-0@lo:101: Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862419.064973:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862419.065022:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526354944:0@lo:101: 00010000:00010000:2.0:1787862419.065072:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.065082:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862419.065174:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355072:0@lo:501: 00000100:00100000:2.0:1787862419.065200:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862419.065219:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651149a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.065334:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355072 00000100:00100000:0.0:1787862419.065339:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355072 00000100:00100000:0.0:1787862419.065366:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862419.065374:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355072:12345-0@lo:501: 00000100:00100000:0.0:1787862419.065571:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355072:12345-0@lo:501: Request processed in 198us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.065578:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787862419.065650:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355072:0@lo:501: 00000100:00100000:2.0:1787862419.065678:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355200:0@lo:503: 00000100:00100000:2.0:1787862419.065712:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862419.065733:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651149a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.065827:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355200 00000100:00100000:0.0:1787862419.065831:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355200 00000100:00100000:0.0:1787862419.065863:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787862419.065870:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355200:12345-0@lo:503: 00000100:00100000:0.0:1787862419.066070:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355200:12345-0@lo:503: Request processed in 200us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.066077:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787862419.068517:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355200:0@lo:503: 00000040:00080000:3.0:1787862419.068846:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862419.068922:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355328:0@lo:502: 00000100:00100000:3.0:1787862419.068992:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.069038:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862419.069152:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355328 00000100:00100000:2.0:1787862419.069159:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355328 00000100:00100000:2.0:1787862419.069201:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787862419.069211:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355328:12345-0@lo:502: 00000100:00100000:2.0:1787862419.069413:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355328:12345-0@lo:502: Request processed in 203us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862419.069420:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787862419.069558:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355328:0@lo:502: 00000040:00080000:3.0:1787862419.069825:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787862419.069868:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787862419.069891:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355456:0@lo:502: 00000100:00100000:3.0:1787862419.069922:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.069951:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862419.070015:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355456 00000100:00100000:1.0:1787862419.070019:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355456 00000100:00100000:1.0:1787862419.070079:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862419.070086:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355456:12345-0@lo:502: 00000100:00100000:1.0:1787862419.070202:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355456:12345-0@lo:502: Request processed in 117us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862419.070209:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787862419.070391:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355456:0@lo:502: 00000040:00080000:3.0:1787862419.070464:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787862419.070472:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787862419.073466:0:6689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862419.073481:0:6689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862419.073483:0:6689:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787862419.073490:0:6689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a653d6d2000 00000020:00000080:2.0:1787862419.073499:0:6689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787862419.073523:0:6689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862419.073526:0:6689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862419.073527:0:6689:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787862419.073530:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787862419.076360:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787862419.076397:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862419.076452:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.076465:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862419.076528:0:6666:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787862419.076531:0:6666:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a653d6d2000 10000000:01000000:3.0:1787862419.076545:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a653d6d2000 10000000:01000000:3.0:1787862419.076548:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787862419.076555:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a653d6d2000 from 1 10000000:01000000:3.0:1787862419.076558:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787862419.076597:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.076607:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.076618:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.076643:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355584:0@lo:101: 00000100:00100000:3.0:1787862419.076712:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.076757:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.076809:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355584 00000100:00100000:0.0:1787862419.076816:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355584 00000100:00100000:0.0:1787862419.076866:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787862419.076876:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526355584:12345-0@lo:101: 00010000:00010000:0.0:1787862419.076897:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862419.076910:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fadb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.076934:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.076943:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862419.076951:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031800, rc 0) 00000100:00100000:0.0:1787862419.076986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355584:12345-0@lo:101: Request processed in 112us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.076993:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787862419.077099:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355584:0@lo:101: 00010000:00010000:3.0:1787862419.077112:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.077120:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.077209:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355712:0@lo:501: 00000100:00100000:3.0:1787862419.077233:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.077264:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.077372:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355712 00000100:00100000:0.0:1787862419.077376:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355712 00000100:00100000:0.0:1787862419.077397:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787862419.077404:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355712:12345-0@lo:501: 00000100:00100000:0.0:1787862419.077614:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355712:12345-0@lo:501: Request processed in 210us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.077621:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787862419.078095:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355712:0@lo:501: 00000100:00100000:3.0:1787862419.078124:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355840:0@lo:503: 00000100:00100000:3.0:1787862419.078172:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.078192:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.078337:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355840 00000100:00100000:0.0:1787862419.078342:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355840 00000100:00100000:0.0:1787862419.078373:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787862419.078380:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355840:12345-0@lo:503: 00000100:00100000:0.0:1787862419.078528:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355840:12345-0@lo:503: Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.078535:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787862419.078605:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355840:0@lo:503: 00000040:00080000:1.0:1787862419.078864:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862419.078916:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355968:0@lo:502: 00000100:00100000:1.0:1787862419.078952:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.078976:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509144b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862419.079018:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526355968 00000100:00100000:0.0:1787862419.079023:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526355968 00000100:00100000:0.0:1787862419.079085:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862419.079092:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355968:12345-0@lo:502: 00000100:00100000:0.0:1787862419.079229:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526355968:12345-0@lo:502: Request processed in 137us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.079234:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787862419.079429:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526355968:0@lo:502: 00000040:00080000:1.0:1787862419.079673:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787862419.079722:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787862419.079758:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787862419.079976:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787862419.080016:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787862419.080426:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787862419.080467:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787862419.080502:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787862419.080553:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787862419.080588:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787862419.080621:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787862419.080668:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787862419.080705:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787862419.080740:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787862419.080786:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787862419.080821:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787862419.080854:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787862419.080903:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787862419.080953:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787862419.081004:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787862419.081378:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787862419.081419:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787862419.081455:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787862419.081507:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787862419.081545:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787862419.081578:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787862419.081626:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787862419.081662:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787862419.081707:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526356096:0@lo:502: 00000100:00100000:1.0:1787862419.081780:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.081826:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509144b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862419.082100:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356096 00000100:00100000:2.0:1787862419.082109:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356096 00000100:00100000:2.0:1787862419.082153:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787862419.082161:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526356096:12345-0@lo:502: 00000100:00100000:2.0:1787862419.082443:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526356096:12345-0@lo:502: Request processed in 282us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862419.082452:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787862419.082627:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526356096:0@lo:502: 00000040:00080000:1.0:1787862419.082696:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787862419.082708:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787862419.083299:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787862419.083314:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a65401c8000) 00000020:00000080:2.0:1787862419.083333:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787862419.083404:0:6690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a653d6d2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787862419.083409:0:6690:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a653d6d2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787862419.083412:0:6690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a653d6d2000 3 00010000:00080000:2.0:1787862419.083439:0:6690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a651c991800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1787862419.085427:0:6690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787862419.085690:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787862419.085729:0:6690:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787862419.085742:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c5536ccf892faf0 00000100:00080000:2.0:1787862419.085753:0:6690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862419.085759:0:6690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a651c991800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862419.085794:0:6690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651682bc00 x1874709526356224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787862419.085826:0:6690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787862419.085928:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526356224:0@lo:38: 00000100:00100000:3.0:1787862419.085997:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.086092:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526356352:0@lo:400: 00000100:00100000:3.0:1787862419.086119:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.086154:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356224 00000100:00100000:3.0:1787862419.086160:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356224 00000100:00100000:3.0:1787862419.086185:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356352 00000100:00100000:3.0:1787862419.086188:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356352 00000100:00100000:3.0:1787862419.086213:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.086221:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526356352:12345-0@lo:400: 00000100:00100000:3.0:1787862419.086278:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526356352:12345-0@lo:400: Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.086286:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.086301:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862419.086305:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526356224:12345-0@lo:38: 00010000:00080000:3.0:1787862419.086324:0:5817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1787862419.086364:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c5536ccf892faf7 00000004:00100000:3.0:1787862419.086378:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787862419.086407:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9a6527d39000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862419.086443:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874709526356224:12345-0@lo:38: Request processed in 136us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.086450:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787862419.086482:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a651682a580 x1874709526356352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862419.086508:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526356352:0@lo:400: 00010000:00080000:3.0:1787862419.086537:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a651682bc00 x1874709526356224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862419.086544:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862419.086550:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787862419.086557:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787862419.086561:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787862419.086563:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787862419.086569:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526356224:0@lo:38: 00000040:00080000:2.0:1787862419.086930:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787862419.087081:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787862419.087111:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862419.087127:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.087138:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787862419.087193:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787862419.087195:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862419.087196:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862419.087197:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862419.087199:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862419.087200:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862419.087202:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862419.087203:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862419.087205:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862419.087206:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862419.087208:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787862419.087211:0:6666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787862419.087214:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862419.087216:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862419.087217:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862419.087218:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862419.087219:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862419.087220:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862419.087221:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862419.087222:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862419.087223:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862419.087224:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862419.087225:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787862419.087411:0:6666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787862419.087425:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526356480:0@lo:253: 00000100:00100000:2.0:1787862419.087483:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862419.087623:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c205a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862419.089624:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356480 00000100:00100000:3.0:1787862419.089637:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356480 00000100:00100000:3.0:1787862419.089692:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787862419.089701:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6666:x1874709526356480:12345-0@lo:253: 20000000:01000000:3.0:1787862419.089730:0:5808:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787862419.089744:0:5808:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787862419.117397:0:5808:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787862419.117414:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787862419.117467:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787862419.117471:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787862419.117491:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.117509:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.117518:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.117553:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.117566:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 13 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862419.117586:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874709526356608:0@lo:104: 00000100:00100000:1.0:1787862419.117644:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862419.117694:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056af480 going to sleep for 11 seconds 00000100:00100000:3.0:1787862419.118842:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356608 00000100:00100000:3.0:1787862419.118852:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356608 00000100:00100000:3.0:1787862419.118893:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862419.118901:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5831:x1874709526356608:12345-0@lo:104: 00010000:00010000:3.0:1787862419.118915:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.118982:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862419.118987:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5831:x1874709526356608:12345-0@lo:104: Request processed in 87us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.119003:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862419.119922:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874709526356608:0@lo:104: 00010000:00010000:1.0:1787862419.119949:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.120642:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862419.120663:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.120672:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfde00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862419.120676:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.120686:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862419.120693:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862419.120699:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862419.120754:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.120761:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862419.120780:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.120787:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfde00/0x9c5536ccf892fa56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa5d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862419.120809:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862419.120811:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862419.120813:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862419.123264:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526356736:0@lo:103: 00000100:00100000:2.0:1787862419.123365:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862419.125487:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356736 00000100:00100000:3.0:1787862419.125501:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356736 00010000:00010000:3.0:1787862419.125539:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 14 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.125623:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862419.125632:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3282:x1874709526356736:12345-0@lo:103: 00010000:00010000:3.0:1787862419.125647:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862419.125652:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 14 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125665:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 14 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125683:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fa56 expref: 14 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125703:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125712:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787862419.125734:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008262755s 00010000:00010000:3.0:1787862419.125739:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125747:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125773:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125780:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125787:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862419.125791:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125798:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125816:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862419.125826:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862419.125894:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3282:x1874709526356736:12345-0@lo:103: Request processed in 263us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862419.125901:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787862419.126811:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.126825:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862419.126830:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45800/0x9c5536ccf892fafe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862419.127240:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526356736:0@lo:103: 00000100:00100000:0.0:1787862419.134818:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:6666:x1874709526356480:12345-0@lo:253: Request processed in 45107us (47323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862419.134838:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787862419.134927:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:6666:1874709526356480:0@lo:253: 10000000:01000000:2.0:1787862419.134958:0:6666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787862419.134962:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787862419.134964:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787862419.134965:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862419.134967:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862419.134968:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862419.134969:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862419.134971:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862419.134973:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862419.134974:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862419.134976:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862419.134977:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787862419.134994:0:6666:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787862419.139886:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862419.140087:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862419.140388:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862419.140556:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862419.140874:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862419.141012:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787862419.142901:0:6666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787862419.404886:0:6666:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787862419.404909:0:6666:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787862419.404953:0:6666:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787862419.405532:0:6666:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787862419.405550:0:6666:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787862419.405581:0:6666:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787862419.996199:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862421.021153:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862422.049570:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862423.069804:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862424.096361:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862424.233033:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526357120:0@lo:400: 00000100:00100000:2.0:1787862424.233081:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526356864:0@lo:400: 00000100:00100000:0.0:1787862424.233170:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526356992:0@lo:400: 00000100:00100000:1.0:1787862424.238400:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862424.238506:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357120 00000100:00100000:1.0:1787862424.238515:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357120 00000100:00100000:1.0:1787862424.238571:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862424.238581:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526357120:12345-0@lo:400: 00000100:00100000:1.0:1787862424.238656:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526357120:12345-0@lo:400: Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862424.238664:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787862424.238685:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787862424.238715:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518ee8000 x1874709526357120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862424.238740:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526357120:0@lo:400: 00000100:00100000:2.0:1787862424.240563:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862424.241575:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356864 00000100:00100000:1.0:1787862424.241585:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356864 00000100:00100000:1.0:1787862424.241640:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787862424.241650:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3283:x1874709526356864:12345-0@lo:400: 00000100:00100000:1.0:1787862424.241725:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3283:x1874709526356864:12345-0@lo:400: Request processed in 76us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862424.241733:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787862424.242788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.243343:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526356864:0@lo:400: 00000100:00100000:1.0:1787862424.243929:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526356992 00000100:00100000:1.0:1787862424.243938:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526356992 00000100:00100000:1.0:1787862424.243995:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862424.244006:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526356992:12345-0@lo:400: 00000100:00100000:1.0:1787862424.244108:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526356992:12345-0@lo:400: Request processed in 105us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862424.244116:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787862424.245600:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518eea1c0 x1874709526356992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862424.245620:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526356992:0@lo:400: 10000000:01000000:1.0:1787862424.735317:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787862424.735326:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a65091a1800 from 21 10000000:01000000:1.0:1787862424.735332:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787862424.735379:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862424.735391:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862424.735405:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862424.735433:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357248:0@lo:101: 00000100:00100000:1.0:1787862424.735530:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862424.735587:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509897d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862424.736636:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357248 00000100:00100000:0.0:1787862424.736647:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357248 00000100:00100000:0.0:1787862424.737279:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787862424.737292:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526357248:12345-0@lo:101: 00010000:00010000:0.0:1787862424.737309:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862424.737326:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb05 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.737353:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.737377:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.737385:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031c00, rc 0) 00000100:00100000:0.0:1787862424.737448:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526357248:12345-0@lo:101: Request processed in 160us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862424.737455:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787862424.737516:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357248:0@lo:101: 00010000:00010000:0.0:1787862424.737533:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862424.737541:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862424.737604:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357376:0@lo:501: 00000100:00100000:0.0:1787862424.737635:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862424.737661:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6533e08480 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.737783:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357376 00000100:00100000:2.0:1787862424.737788:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357376 00000100:00100000:2.0:1787862424.737816:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862424.737824:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526357376:12345-0@lo:501: 00000100:00100000:2.0:1787862424.739800:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526357376:12345-0@lo:501: Request processed in 1971us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.739813:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862424.740006:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357376:0@lo:501: 00000100:00100000:2.0:1787862424.740070:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357504:0@lo:503: 00000100:00100000:2.0:1787862424.740121:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.740211:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.740227:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357504 00000100:00100000:2.0:1787862424.740232:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357504 00000100:00100000:2.0:1787862424.740265:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862424.740273:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526357504:12345-0@lo:503: 00000100:00100000:2.0:1787862424.740438:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526357504:12345-0@lo:503: Request processed in 165us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.740444:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862424.740486:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357504:0@lo:503: 00000100:00100000:2.0:1787862424.740744:0:6919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6919:1874709526357632:0@lo:502: 00000100:00100000:2.0:1787862424.740777:0:6919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.740795:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357632 00000100:00100000:2.0:1787862424.740799:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357632 00000100:00100000:2.0:1787862424.740817:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787862424.740823:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6919:x1874709526357632:12345-0@lo:502: 00000100:00100000:2.0:1787862424.740959:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6919:x1874709526357632:12345-0@lo:502: Request processed in 135us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.740966:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787862424.741340:0:6919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.741359:0:6919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6919:1874709526357632:0@lo:502: 00000100:00100000:2.0:1787862424.741400:0:6919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6919:1874709526357760:0@lo:502: 00000100:00100000:2.0:1787862424.741433:0:6919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.741453:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357760 00000100:00100000:2.0:1787862424.741457:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357760 00000100:00100000:2.0:1787862424.741476:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862424.741482:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6919:x1874709526357760:12345-0@lo:502: 00000100:00100000:2.0:1787862424.741604:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:6919:x1874709526357760:12345-0@lo:502: Request processed in 121us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.741610:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862424.741639:0:6919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.741651:0:6919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6919:1874709526357760:0@lo:502: 00000040:00080000:2.0:1787862424.741681:0:6919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787862424.741729:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787862424.741749:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862424.741760:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.741771:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862424.741780:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787862424.741783:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a65091a1800 from 4 10000000:01000000:2.0:1787862424.741785:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862424.741807:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.741814:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.741829:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862424.741841:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357888:0@lo:101: 00000100:00100000:2.0:1787862424.741865:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.741878:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.741889:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526357888 00000100:00100000:2.0:1787862424.741891:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526357888 00000100:00100000:2.0:1787862424.741910:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862424.741916:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526357888:12345-0@lo:101: 00010000:00010000:2.0:1787862424.741923:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862424.741935:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb13 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.741951:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.741960:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.741968:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:2.0:1787862424.742005:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526357888:12345-0@lo:101: Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.742011:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862424.742036:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526357888:0@lo:101: 00010000:00010000:2.0:1787862424.742070:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.742088:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862424.742124:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358016:0@lo:256: 00000100:00100000:2.0:1787862424.742270:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.742285:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.742297:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358016 00000100:00100000:2.0:1787862424.742301:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358016 00000100:00100000:2.0:1787862424.742320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862424.742325:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526358016:12345-0@lo:256: 20000000:01000000:2.0:1787862424.742337:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787862424.742352:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787862424.742355:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787862424.742426:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526358016:12345-0@lo:256: Request processed in 99us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.742432:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862424.742461:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358016:0@lo:256: 10000000:01000000:2.0:1787862424.742500:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862424.742505:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.742512:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862424.742519:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787862424.742521:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787862424.742523:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787862424.742541:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.742547:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.742554:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862424.742564:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358144:0@lo:101: 00000100:00100000:2.0:1787862424.742585:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.742597:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d2ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.742607:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358144 00000100:00100000:2.0:1787862424.742610:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358144 00000100:00100000:2.0:1787862424.742630:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862424.742636:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526358144:12345-0@lo:101: 00010000:00010000:2.0:1787862424.742643:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862424.742653:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb21 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.743231:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.743246:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.743253:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:2.0:1787862424.743286:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526358144:12345-0@lo:101: Request processed in 649us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.743292:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862424.743606:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358144:0@lo:101: 00010000:00010000:2.0:1787862424.743620:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.743628:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862424.743835:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358272:0@lo:501: 00000100:00100000:2.0:1787862424.743866:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.743891:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d2ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.744840:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358272 00000100:00100000:2.0:1787862424.744849:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358272 00000100:00100000:2.0:1787862424.744895:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862424.744903:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526358272:12345-0@lo:501: 00000100:00100000:2.0:1787862424.745246:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526358272:12345-0@lo:501: Request processed in 344us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.745254:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862424.745299:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358272:0@lo:501: 00000100:00100000:2.0:1787862424.745337:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358400:0@lo:503: 00000100:00100000:2.0:1787862424.745376:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.745400:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d2ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.745414:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358400 00000100:00100000:2.0:1787862424.745417:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358400 00000100:00100000:2.0:1787862424.745437:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862424.745443:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526358400:12345-0@lo:503: 00000100:00100000:2.0:1787862424.745643:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526358400:12345-0@lo:503: Request processed in 199us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.745658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862424.750245:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358400:0@lo:503: 00000100:00100000:3.0:1787862424.750905:0:6921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6921:1874709526358528:0@lo:502: 00000100:00100000:3.0:1787862424.750989:0:6921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862424.751032:0:6921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.751125:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358528 00000100:00100000:2.0:1787862424.751132:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358528 00000100:00100000:2.0:1787862424.751832:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787862424.751842:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:6921:x1874709526358528:12345-0@lo:502: 00000100:00100000:2.0:1787862424.752321:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:6921:x1874709526358528:12345-0@lo:502: Request processed in 479us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.752330:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787862424.752448:0:6921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6921:1874709526358528:0@lo:502: 00000020:01000000:3.0:1787862424.752483:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787862424.752492:0:6921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787862424.752499:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862424.752501:0:6921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787862424.752506:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787862424.752510:0:6921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:3.0:1787862424.752532:0:6921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787862424.752535:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787862424.752560:0:6921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a640328ced8) 00000020:00000080:3.0:1787862424.752580:0:6921:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787862424.752587:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787862424.752665:0:6921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787862424.753237:0:6921:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787862424.753247:0:6921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892fb36 00010000:00080000:3.0:1787862424.753279:0:6921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6403293800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:3.0:1787862424.753500:0:6921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787862424.915931:0:6921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787862424.915953:0:6921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787862424.916627:0:6921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862424.916886:0:6921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862424.916940:0:6921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787862424.917013:0:6921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787862424.919947:0:6936:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862424.919955:0:6936:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787862424.921143:0:6921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787862424.921156:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787862424.921187:0:6921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787862424.921206:0:6921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf892fb3d 00000100:00080000:3.0:1787862424.921216:0:6921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787862424.921221:0:6921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6403293800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787862424.921254:0:6921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6518ec4780 x1874709526358656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862424.921309:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526358656:0@lo:8: 00000100:00100000:2.0:1787862424.921380:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787862424.921515:0:6921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787862424.921595:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862424.921600:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862424.921602:0:6921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787862424.921610:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862424.921615:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862424.921617:0:6921:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787862424.921620:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787862424.921622:0:6921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787862424.921646:0:6921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6921:1874709526358784:0@lo:502: 00000100:00100000:3.0:1787862424.921766:0:6921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862424.921784:0:6921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.921890:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358656 00000100:00100000:2.0:1787862424.921897:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358656 00000100:00100000:2.0:1787862424.921965:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862424.921981:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526358656:12345-0@lo:8: 00010000:00080000:2.0:1787862424.922004:0:6670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:2.0:1787862424.922031:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf892fb44 00002000:00100000:2.0:1787862424.922106:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a6507b13800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787862424.922119:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787862424.922123:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787862424.922245:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787862424.922401:0:6670:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787862424.922500:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a6507b12800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862424.922555:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874709526358656:12345-0@lo:8: Request processed in 574us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.922563:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862424.922809:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358784 00000100:00100000:2.0:1787862424.922814:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358784 00000100:00100000:2.0:1787862424.922878:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787862424.922887:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:6921:x1874709526358784:12345-0@lo:502: 00000100:00100000:2.0:1787862424.923136:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:6921:x1874709526358784:12345-0@lo:502: Request processed in 249us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.923143:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1787862424.923354:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518ec4780 x1874709526358656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862424.923365:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787862424.923372:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787862424.923380:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787862424.923385:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787862424.923387:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6403293800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787862424.923496:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787862424.923503:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526358656:0@lo:8: 00000100:00100000:2.0:1787862424.923539:0:6921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:6921:1874709526358784:0@lo:502: 00000020:01000000:2.0:1787862424.923567:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862424.923579:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862424.923581:0:6921:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787862424.923586:0:6921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787862424.924320:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787862424.924345:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787862424.924355:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.924366:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862424.924376:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787862424.924379:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a653aa2b490 from 1 10000000:01000000:3.0:1787862424.924382:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787862424.924487:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.924496:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.924506:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862424.924525:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358912:0@lo:101: 00000100:00100000:3.0:1787862424.924577:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862424.924615:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.924738:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526358912 00000100:00100000:2.0:1787862424.924744:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526358912 00000100:00100000:2.0:1787862424.924825:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862424.924835:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526358912:12345-0@lo:101: 00010000:00010000:2.0:1787862424.924847:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862424.924861:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb4b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.924882:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.924892:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.924900:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd400, rc 0) 00000100:00100000:2.0:1787862424.924940:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526358912:12345-0@lo:101: Request processed in 107us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862424.924947:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:0.0:1787862424.925067:0:6936:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787862424.925258:0:6936:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 150689214810ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787862424.925779:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526358912:0@lo:101: 00010000:00010000:2.0:1787862424.925800:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862424.925811:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862424.925877:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526359040:0@lo:501: 00000100:00100000:2.0:1787862424.925928:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.925957:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862424.930789:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359040 00000100:00100000:2.0:1787862424.930804:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359040 00000100:00100000:3.0:1787862424.931035:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862424.931068:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526359040:12345-0@lo:501: 00000100:00100000:3.0:1787862424.931334:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526359040:12345-0@lo:501: Request processed in 268us (5404us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862424.931342:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862424.931396:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526359040:0@lo:501: 10000000:01000000:3.0:1787862424.931557:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787862424.931566:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862424.931577:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862424.993589:0:6937:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787862424.993624:0:6937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359296:0@lo:7: 00000100:00100000:1.0:1787862424.993904:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526359168:0@lo:13: 00000100:00100000:2.0:1787862424.994965:0:6937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862424.995028:0:6937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862424.995575:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862424.995779:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359296 00000100:00100000:3.0:1787862424.995787:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359296 00000100:00100000:3.0:1787862424.995837:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862424.995845:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6937:x1874709526359296:12345-0@lo:7: 00000100:00100000:0.0:1787862424.996823:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359168 00000100:00100000:0.0:1787862424.996832:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359168 00000100:00100000:0.0:1787862424.996869:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862424.996878:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526359168:12345-0@lo:13: 00002000:00000024:0.0:1787862424.996900:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787862424.996983:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526359168:12345-0@lo:13: Request processed in 92us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862424.997000:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787862424.997067:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a65168283c0 x1874709526359168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862424.997087:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526359168:0@lo:13: 00000100:00080000:3.0:1787862425.010687:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787862425.022585:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787862425.022594:0:6672:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787862425.022690:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6937:x1874709526359296:12345-0@lo:7: Request processed in 26842us (27723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862425.022701:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787862425.029438:0:6937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651682bc00 x1874709526359296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787862440 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862425.029457:0:6937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359296:0@lo:7: 00000004:00080000:2.0:1787862425.029473:0:6937:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787862425.029519:0:6937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359424:0@lo:5: 00000100:00100000:2.0:1787862425.029579:0:6937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862425.029630:0:6937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862425.029743:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359424 00000100:00100000:2.0:1787862425.029750:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359424 00000100:00100000:2.0:1787862425.029798:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862425.029807:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6937:x1874709526359424:12345-0@lo:5: 00002000:00080000:2.0:1787862425.029835:0:6670:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787862425.029840:0:6670:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787862425.030211:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6937:x1874709526359424:12345-0@lo:5: Request processed in 403us (631us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787862425.030218:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787862425.030253:0:6937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651682bc00 x1874709526359424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862441 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862425.030265:0:6937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359424:0@lo:5: 00000004:00080000:2.0:1787862425.030282:0:6937:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787862425.030307:0:6937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359552:0@lo:700: 00000100:00100000:2.0:1787862425.030333:0:6937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862425.030354:0:6937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862425.030495:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359552 00000100:00100000:1.0:1787862425.030500:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359552 00000100:00100000:1.0:1787862425.030533:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862425.030541:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6937:x1874709526359552:12345-0@lo:700: 00000100:00100000:1.0:1787862425.030569:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6678:1874709526359680:0@lo:700: 00000100:00100000:1.0:1787862425.030600:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862425.030620:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056afc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862425.030936:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359680 00000100:00100000:0.0:1787862425.030942:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359680 00000100:00100000:0.0:1787862425.030985:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862425.030992:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6678:x1874709526359680:12345-0@lo:700: 00000004:00080000:3.0:1787862425.053871:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787862425.129528:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1787862425.137469:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787862425.148459:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6678:x1874709526359680:12345-0@lo:700: Request processed in 117458us (117848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862425.148479:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787862425.149579:0:6678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518ee8f00 x1874709526359680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787862441 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862425.149597:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6678:1874709526359680:0@lo:700: 40000000:02000000:1.0:1787862425.149612:0:6678:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787862425.298002:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787862425.298016:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787862425.298800:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6937:x1874709526359552:12345-0@lo:700: Request processed in 268253us (268459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862425.298814:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787862425.298963:0:6937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6516828b40 x1874709526359552/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787862441 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862425.298986:0:6937:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787862425.299006:0:6937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359552:0@lo:700: 00000004:02000040:2.0:1787862425.387789:0:6937:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787862425.399621:0:6937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359808:0@lo:5: 00000100:00100000:3.0:1787862425.399718:0:6937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862425.399773:0:6937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640197f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862425.400630:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359808 00000100:00100000:2.0:1787862425.400642:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359808 00000100:00100000:2.0:1787862425.400713:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862425.400724:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6937:x1874709526359808:12345-0@lo:5: 00002000:00080000:2.0:1787862425.427470:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787862425.427493:0:6672:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787862425.456389:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6937:x1874709526359808:12345-0@lo:5: Request processed in 55658us (56662us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787862425.456520:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787862425.456580:0:6937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518ec7840 x1874709526359808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862441 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862425.456597:0:6937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6937:1874709526359808:0@lo:5: 00000004:00080000:2.0:1787862425.456612:0:6937:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787862426.141192:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862427.169316:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787862427.368626:0:7043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787862428.189217:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862429.223787:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862430.236334:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862430.364962:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526359936:0@lo:400: 00000100:00100000:0.0:1787862430.364962:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526360064:0@lo:400: 00000100:00100000:3.0:1787862430.365170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862430.365235:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526359936 00000100:00100000:3.0:1787862430.365242:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526359936 00000100:00100000:3.0:1787862430.365275:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787862430.365283:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3283:x1874709526359936:12345-0@lo:400: 00000100:00100000:3.0:1787862430.365327:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3283:x1874709526359936:12345-0@lo:400: Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862430.365334:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787862430.365373:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526359936:0@lo:400: 00000100:00100000:3.0:1787862430.365410:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526360192:0@lo:400: 00000100:00100000:3.0:1787862430.365433:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862430.365450:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862430.365455:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526360320:0@lo:400: 00000100:00100000:3.0:1787862430.365474:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862430.365503:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360320 00000100:00100000:3.0:1787862430.365507:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360320 00000100:00100000:3.0:1787862430.365537:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862430.365544:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526360320:12345-0@lo:400: 00000100:00100000:1.0:1787862430.365825:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360192 00000100:00100000:1.0:1787862430.365830:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360192 00000100:00100000:1.0:1787862430.365873:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862430.365880:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526360192:12345-0@lo:400: 00000100:00100000:3.0:1787862430.366011:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526360320:12345-0@lo:400: Request processed in 467us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862430.366018:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862430.366075:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526360192:12345-0@lo:400: Request processed in 195us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862430.366146:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862430.366184:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787862430.366192:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787862430.366666:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862430.366686:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360064 00000100:00100000:1.0:1787862430.367656:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360064 00000100:00100000:1.0:1787862430.367707:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862430.367716:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526360064:12345-0@lo:400: 00000100:00100000:1.0:1787862430.367895:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526360064:12345-0@lo:400: Request processed in 180us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862430.367902:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787862430.368063:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518f0a1c0 x1874709526360064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862430.368078:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526360064:0@lo:400: 00000100:00100000:2.0:1787862430.372980:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526360448:0@lo:13: 00000100:00100000:2.0:1787862430.373064:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862430.373147:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360448 00000100:00100000:2.0:1787862430.373155:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360448 00000100:00100000:2.0:1787862430.373194:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862430.373202:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526360448:12345-0@lo:13: 00002000:00000024:2.0:1787862430.373228:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862430.373268:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526360448:12345-0@lo:13: Request processed in 67us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862430.373274:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787862430.373307:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6516828b40 x1874709526360448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862430.373326:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526360448:0@lo:13: 00010000:00080000:2.0:1787862430.373454:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518f092c0 x1874709526360320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862430.373463:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526360320:0@lo:400: 00010000:00080000:2.0:1787862430.373481:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518f083c0 x1874709526360192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862430.373489:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526360192:0@lo:400: 00000100:00080000:3.0:1787862430.376676:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862430.376842:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787862430.475899:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787862431.262891:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862432.290696:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862433.315262:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862434.332916:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862435.356334:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862435.485387:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526360960:0@lo:400: 00000100:00100000:1.0:1787862435.485614:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526360576:0@lo:400: 00000100:00100000:3.0:1787862435.489661:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526360704:0@lo:400: 00000100:00100000:1.0:1787862435.492463:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862435.492512:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360576 00000100:00100000:1.0:1787862435.492529:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360576 00000100:00100000:1.0:1787862435.492574:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787862435.492583:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3284:x1874709526360576:12345-0@lo:400: 00000100:00100000:1.0:1787862435.492633:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3284:x1874709526360576:12345-0@lo:400: Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862435.492641:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787862435.492712:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526360576:0@lo:400: 00000100:00100000:1.0:1787862435.492741:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526361088:0@lo:13: 00000100:00100000:1.0:1787862435.492775:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862435.495001:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361088 00000100:00100000:0.0:1787862435.495017:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361088 00000100:00100000:0.0:1787862435.495089:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862435.495098:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526361088:12345-0@lo:13: 00002000:00000024:0.0:1787862435.495132:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862435.495211:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526361088:12345-0@lo:13: Request processed in 114us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862435.495227:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787862435.495414:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518f092c0 x1874709526361088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862435.495483:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787862435.495508:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526361088:0@lo:13: 00000100:00100000:0.0:1787862435.496334:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526360832:0@lo:400: 00000100:00100000:0.0:1787862435.496399:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862435.496509:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360832 00000100:00100000:1.0:1787862435.496515:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360832 00000100:00100000:2.0:1787862435.496595:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862435.496630:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360960 00000100:00100000:2.0:1787862435.496634:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360960 00000100:00100000:2.0:1787862435.496685:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862435.496694:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526360960:12345-0@lo:400: 00000100:00100000:2.0:1787862435.496756:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526360960:12345-0@lo:400: Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862435.496762:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787862435.496796:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651682b480 x1874709526360960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862435.496807:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526360960:0@lo:400: 00000100:00080000:2.0:1787862435.496837:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862435.496917:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862435.496924:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526360832:12345-0@lo:400: 00000100:00100000:1.0:1787862435.496965:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526360832:12345-0@lo:400: Request processed in 42us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862435.496972:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787862435.497000:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6516829e00 x1874709526360832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862435.497009:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526360832:0@lo:400: 00000100:00080000:2.0:1787862435.497594:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862435.497761:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862435.497795:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526360704 00000100:00100000:3.0:1787862435.497801:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526360704 00000100:00100000:3.0:1787862435.497828:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862435.497835:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526360704:12345-0@lo:400: 00000100:00100000:3.0:1787862435.497883:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526360704:12345-0@lo:400: Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862435.497891:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787862435.497921:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6516828780 x1874709526360704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862435.497933:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526360704:0@lo:400: 00010000:00010000:2.0:1787862436.381777:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862437.415749:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862438.428256:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862439.452274:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787862439.969365:0:7615:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787862439.969370:0:7615:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787862439.969546:0:7615:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a651c992800 00000020:01000004:2.0:1787862439.969564:0:7615:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787862439.969578:0:7615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787862439.969600:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6533ee9a48) 00000020:00000080:2.0:1787862439.969618:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787862439.982583:0:7615:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787862439.982753:0:7615:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787862440.000507:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787862440.004330:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787862440.004354:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787862440.004388:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787862440.004403:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787862440.004732:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787862440.004742:0:7615:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787862440.004751:0:7615:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c5536ccf892fb60 00000020:01000004:3.0:1787862440.004758:0:7615:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787862440.004781:0:7615:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787862440.004783:0:7615:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787862440.004787:0:7615:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787862440.004810:0:7615:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787862440.004815:0:7615:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787862440.020495:0:7615:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787862440.020618:0:7615:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.160@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787862440.020623:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787862440.020625:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787862440.020626:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862440.020628:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862440.020629:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862440.020630:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862440.020632:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862440.020633:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862440.020635:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862440.020637:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862440.020638:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862440.020647:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787862440.020650:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862440.020651:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787862440.020652:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862440.020652:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862440.020653:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862440.020654:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862440.020655:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787862440.020656:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787862440.020657:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787862440.020658:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862440.020658:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787862440.020687:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787862440.020706:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526361216:0@lo:253: 00000100:00100000:2.0:1787862440.020782:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.020980:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862440.021040:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361216 00000100:00100000:3.0:1787862440.021121:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361216 00000100:00100000:3.0:1787862440.021224:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787862440.021236:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:7615:x1874709526361216:12345-0@lo:253: 20000000:01000000:3.0:1787862440.021266:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787862440.021270:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787862440.021275:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787862440.021278:0:5810:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787862440.022385:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862440.022638:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787862440.022653:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787862440.022700:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787862440.022707:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787862440.022744:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787862440.022800:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787862440.024526:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787862440.024636:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:3.0:1787862440.024639:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:3.0:1787862440.024685:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787862440.024694:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787862440.024749:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787862440.024758:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:3.0:1787862440.025361:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787862440.025376:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787862440.025421:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787862440.025485:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787862440.026875:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787862440.026902:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.160@tcp 20000000:01000000:3.0:1787862440.026905:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.160@tcp (null) (null) (null) 00000040:00080000:3.0:1787862440.026978:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787862440.026988:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787862440.027026:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787862440.027033:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.160@tcp (null) (null) 00000040:00080000:3.0:1787862440.027177:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787862440.027188:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787862440.027257:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787862440.027301:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787862440.027319:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787862440.027322:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787862440.027326:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787862440.027338:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787862440.027341:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787862440.027375:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787862440.027377:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862440.028265:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862440.028327:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862440.028385:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787862440.028739:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787862440.028778:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787862440.028921:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787862440.028938:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787862440.028941:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787862440.029622:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787862440.029963:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787862440.030005:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787862440.030215:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787862440.030231:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787862440.030233:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862440.030941:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862440.031020:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862440.031084:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787862440.031358:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787862440.031398:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787862440.031452:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787862440.031466:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787862440.031468:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787862440.032202:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787862440.032261:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787862440.032325:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787862440.032675:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787862440.032715:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787862440.032770:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787862440.032785:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787862440.032871:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787862440.032881:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787862440.032900:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.032918:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.032936:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.032943:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.032950:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.032956:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.032963:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.033000:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.033016:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.033031:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f083c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361344:0@lo:104: 00000100:00100000:0.0:1787862440.036236:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862440.036369:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.036385:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.036400:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f092c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361472:0@lo:104: 00010000:00010000:0.0:1787862440.036450:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.036460:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 16 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.036468:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0bc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361600:0@lo:104: 00010000:00010000:0.0:1787862440.036493:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.036500:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.036509:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361728:0@lo:104: 00010000:00010000:0.0:1787862440.036557:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.036565:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.036573:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361856:0@lo:104: 00000100:00100000:0.0:1787862440.036593:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509c31900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.036688:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787862440.036707:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.036767:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.037032:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.037102:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361344 00000100:00100000:3.0:1787862440.037110:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361344 00000100:00100000:3.0:1787862440.037152:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361472 00000100:00100000:3.0:1787862440.037156:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361472 00000100:00100000:3.0:1787862440.037176:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361600 00000100:00100000:3.0:1787862440.037179:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361600 00000100:00100000:3.0:1787862440.037191:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862440.037199:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6510a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5810:x1874709526361344:12345-0@lo:104: 00010000:00010000:3.0:1787862440.037211:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.037268:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862440.037274:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6510a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:5810:x1874709526361344:12345-0@lo:104: Request processed in 77us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.037281:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862440.037322:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862440.037329:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:5810:x1874709526361472:12345-0@lo:104: 00010000:00010000:3.0:1787862440.037335:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.037368:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787862440.037373:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:5810:x1874709526361472:12345-0@lo:104: Request processed in 46us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.037378:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862440.037391:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862440.037397:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5810:x1874709526361600:12345-0@lo:104: 00010000:00010000:3.0:1787862440.037404:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.037430:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787862440.037435:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5810:x1874709526361600:12345-0@lo:104: Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.037448:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787862440.037505:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787862440.037513:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.037521:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862440.037525:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.037558:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862440.037564:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862440.037570:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862440.037643:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862440.037778:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862440.037786:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.037950:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.037958:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862440.037977:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.037984:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fb4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb52 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.038000:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.038001:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.038003:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862440.038015:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526361984:0@lo:103: 00000100:00100000:0.0:1787862440.038070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862440.038116:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361984 00000100:00100000:0.0:1787862440.038121:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361984 00010000:00010000:0.0:1787862440.038139:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 17 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.038163:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862440.038169:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3281:x1874709526361984:12345-0@lo:103: 00010000:00010000:0.0:1787862440.038188:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862440.038193:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 17 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.038203:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 17 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.038220:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862440.038250:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3281:x1874709526361984:12345-0@lo:103: Request processed in 81us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.038256:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862440.038291:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526361984:0@lo:103: 00010000:00010000:0.0:1787862440.038320:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fb52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fb4b expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.038336:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f083c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361344:0@lo:104: 00000100:00100000:0.0:1787862440.038345:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f092c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361472:0@lo:104: 00000100:00100000:0.0:1787862440.038352:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0bc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361600:0@lo:104: 00010000:00010000:2.0:1787862440.038426:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862440.038430:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.038438:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862440.038444:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862440.038449:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787862440.038510:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.038522:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361728 00000100:00100000:1.0:1787862440.038638:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361728 00000100:00100000:1.0:1787862440.038660:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526361856 00000100:00100000:1.0:1787862440.038663:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526361856 00000100:00100000:1.0:1787862440.038676:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787862440.038682:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:5810:x1874709526361728:12345-0@lo:104: 00010000:00010000:1.0:1787862440.038691:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.038743:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862440.038749:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:5810:x1874709526361728:12345-0@lo:104: Request processed in 68us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.038755:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787862440.038777:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787862440.038784:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5810:x1874709526361856:12345-0@lo:104: 00010000:00010000:0.0:1787862440.038877:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862440.038882:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.038888:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862440.038891:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.038898:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862440.038915:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862440.038920:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787862440.038943:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.038972:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862440.038978:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5810:x1874709526361856:12345-0@lo:104: Request processed in 195us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.038983:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787862440.039418:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361728:0@lo:104: 00000100:00100000:1.0:1787862440.039428:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874709526361856:0@lo:104: 00010000:00010000:1.0:1787862440.039457:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039590:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039608:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862440.039634:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039641:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb28 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039653:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862440.039657:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039663:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862440.039667:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039674:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862440.039681:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862440.039686:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862440.039701:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039708:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862440.039722:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039729:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af44000/0x9c5536ccf892fab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fab8 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039746:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.039747:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.039749:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862440.039765:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526362240:0@lo:103: 00000100:00100000:2.0:1787862440.039819:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.039878:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362240 00000100:00100000:2.0:1787862440.039883:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362240 00010000:00010000:2.0:1787862440.039903:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862440.039927:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862440.039934:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3283:x1874709526362240:12345-0@lo:103: 00010000:00010000:2.0:1787862440.039945:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862440.039949:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039959:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039973:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500030200/0x9c5536ccf892fab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fab1 expref: 16 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.039986:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862440.040013:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:3283:x1874709526362240:12345-0@lo:103: Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862440.040020:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862440.040064:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526362240:0@lo:103: 00000100:00100000:1.0:1787862440.040359:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526362112:0@lo:103: 00000100:00100000:1.0:1787862440.040389:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862440.040496:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.040504:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862440.040514:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.040521:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fadb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fae2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.040595:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526362368:0@lo:103: 00000100:00100000:1.0:1787862440.040629:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862440.041027:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.041028:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.041030:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862440.048822:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362112 00000100:00100000:0.0:1787862440.048846:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362112 00010000:00010000:0.0:1787862440.048897:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 15 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.048926:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362368 00000100:00100000:0.0:1787862440.048930:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362368 00010000:00010000:0.0:1787862440.048941:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.048952:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862440.048960:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3282:x1874709526362112:12345-0@lo:103: 00010000:00010000:0.0:1787862440.048975:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862440.048995:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.049007:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.049028:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fb28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fb21 expref: 16 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.049072:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862440.049165:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:3282:x1874709526362112:12345-0@lo:103: Request processed in 206us (8775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.049173:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862440.049189:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862440.049195:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3284:x1874709526362368:12345-0@lo:103: 00010000:00010000:0.0:1787862440.049204:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862440.049208:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 14 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.049216:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 14 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.049226:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fadb expref: 14 pid: 5809 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.049236:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862440.049273:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3284:x1874709526362368:12345-0@lo:103: Request processed in 78us (8642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.049279:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862440.049326:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526362368:0@lo:103: 00000100:00100000:1.0:1787862440.049500:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526362112:0@lo:103: 00010000:00010000:0.0:1787862440.052304:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.052311:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.052313:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.052339:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.052351:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862440.052355:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.052365:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862440.052372:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862440.052378:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862440.052428:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.052435:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787862440.052483:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526362496:0@lo:103: 00000100:00100000:0.0:1787862440.052612:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.052702:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362496 00000100:00100000:1.0:1787862440.052708:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362496 00010000:00010000:1.0:1787862440.052732:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 13 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.052760:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787862440.052766:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3281:x1874709526362496:12345-0@lo:103: 00010000:00010000:1.0:1787862440.052777:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862440.052804:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 13 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052817:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 13 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052840:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fb0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fb05 expref: 13 pid: 5808 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052856:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052865:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052880:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052887:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052893:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052900:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052905:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862440.052909:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052916:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052938:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.052947:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862440.053000:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.053008:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af44800/0x9c5536ccf892fb05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb0c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.053022:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.053024:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.053026:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862440.053346:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3281:x1874709526362496:12345-0@lo:103: Request processed in 578us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.053354:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787862440.053385:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.053392:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.053398:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fb67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787862440.053409:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787862440.053502:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526362496:0@lo:103: 00000100:00100000:3.0:1787862440.100852:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:7615:x1874709526361216:12345-0@lo:253: Request processed in 79596us (80048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.100866:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787862440.101431:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526361216:0@lo:253: 10000000:01000000:0.0:1787862440.101449:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787862440.101453:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862440.101455:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862440.101457:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862440.101458:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787862440.101460:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862440.101462:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862440.101463:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862440.101465:0:7615:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787862440.101467:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862440.101469:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787862440.101490:0:7615:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a651c992800 from lustre-OST0001 10000000:01000000:0.0:1787862440.101517:0:7615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787862440.101520:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787862440.101541:0:7615:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a653aa2b490 local copy 10000000:01000000:0.0:1787862440.101545:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787862440.101579:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.101592:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.101603:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862440.101641:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526362624:0@lo:101: 00000100:00100000:0.0:1787862440.101682:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862440.101712:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509c31240 going to sleep for 11 seconds 00000100:00100000:3.0:1787862440.101936:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362624 00000100:00100000:3.0:1787862440.101943:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362624 00000100:00100000:3.0:1787862440.101988:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787862440.101998:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:7615:x1874709526362624:12345-0@lo:101: 00010000:00010000:3.0:1787862440.102012:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862440.102026:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fb75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb6e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.102078:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fb75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb6e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.102091:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fb75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb6e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.102101:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501685e00, rc 0) 00000100:00100000:3.0:1787862440.102134:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526362624:12345-0@lo:101: Request processed in 138us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.102141:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787862440.102226:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526362624:0@lo:101: 00010000:00010000:2.0:1787862440.102240:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.102262:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862440.102383:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526362752:0@lo:501: 00000100:00100000:2.0:1787862440.102413:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.102443:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651faddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862440.102501:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362752 00000100:00100000:3.0:1787862440.102505:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362752 00000100:00100000:3.0:1787862440.102548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787862440.102555:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526362752:12345-0@lo:501: 00000100:00100000:3.0:1787862440.102799:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526362752:12345-0@lo:501: Request processed in 233us (374us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862440.102816:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862440.103091:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526362752:0@lo:501: 10000000:01000000:2.0:1787862440.103104:0:7615:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787862440.103133:0:7615:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787862440.103140:0:7615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103148:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103157:0:7615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103174:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787862440.103192:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a651c992800 10000000:01000000:2.0:1787862440.103197:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787862440.103202:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787862440.103204:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862440.103208:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787862440.103211:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787862440.103231:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103251:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103259:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862440.103271:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526362880:0@lo:101: 00000100:00100000:2.0:1787862440.103304:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.103327:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd240 going to sleep for 11 seconds 00010000:00010000:2.0:1787862440.103340:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862440.103346:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103354:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862440.103358:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103366:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862440.103372:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862440.103378:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862440.103396:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103402:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862440.103422:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103435:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918600/0x9c5536ccf892fb6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c5536ccf892fb75 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103447:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.103449:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862440.103451:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862440.103463:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526363008:0@lo:103: 00000100:00100000:2.0:1787862440.103493:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.103608:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363008 00000100:00100000:2.0:1787862440.103613:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363008 00000100:00100000:2.0:1787862440.103653:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862440.103661:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3282:x1874709526363008:12345-0@lo:103: 00010000:00010000:2.0:1787862440.103674:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862440.103688:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fb75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fb6e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.103705:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862440.103735:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:3282:x1874709526363008:12345-0@lo:103: Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862440.103743:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862440.103771:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526363008:0@lo:103: 00000100:00100000:0.0:1787862440.103959:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526362880 00000100:00100000:0.0:1787862440.103964:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526362880 00000100:00100000:0.0:1787862440.103993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862440.104001:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+11:7615:x1874709526362880:12345-0@lo:101: 00010000:00010000:0.0:1787862440.104010:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862440.104024:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb7c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.104071:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.104082:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.104088:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918200, rc 0) 00000100:00100000:0.0:1787862440.104374:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526362880:12345-0@lo:101: Request processed in 373us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.104381:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787862440.104510:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526362880:0@lo:101: 00010000:00010000:2.0:1787862440.104524:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.104547:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862440.104651:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363136:0@lo:501: 00000100:00100000:2.0:1787862440.104679:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.104781:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.105029:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363136 00000100:00100000:0.0:1787862440.105035:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363136 00000100:00100000:1.0:1787862440.105319:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787862440.105329:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363136:12345-0@lo:501: 00000100:00100000:1.0:1787862440.105695:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363136:12345-0@lo:501: Request processed in 367us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.105703:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862440.105948:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363136:0@lo:501: 00000100:00100000:2.0:1787862440.105991:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363264:0@lo:503: 00000100:00100000:2.0:1787862440.106067:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.106144:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787862440.106180:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363264 00000100:00100000:3.0:1787862440.106185:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363264 00000100:00100000:3.0:1787862440.106266:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787862440.106274:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363264:12345-0@lo:503: 00000100:00100000:3.0:1787862440.106443:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363264:12345-0@lo:503: Request processed in 170us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.106450:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787862440.106512:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363264:0@lo:503: 00000040:00080000:2.0:1787862440.106824:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862440.106900:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363392:0@lo:502: 00000100:00100000:2.0:1787862440.106941:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.107762:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.107977:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363392 00000100:00100000:0.0:1787862440.107985:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363392 00000100:00100000:0.0:1787862440.108021:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787862440.108029:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363392:12345-0@lo:502: 00000100:00100000:0.0:1787862440.108246:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363392:12345-0@lo:502: Request processed in 217us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.108259:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787862440.108369:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363392:0@lo:502: 00000040:00080000:2.0:1787862440.108638:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787862440.108689:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787862440.108718:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787862440.108763:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787862440.108813:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787862440.109022:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787862440.109087:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363520:0@lo:502: 00000100:00100000:2.0:1787862440.109137:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.109161:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.109216:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363520 00000100:00100000:0.0:1787862440.109221:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363520 00000100:00100000:0.0:1787862440.109244:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862440.109251:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363520:12345-0@lo:502: 00000100:00100000:0.0:1787862440.109400:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363520:12345-0@lo:502: Request processed in 149us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.109407:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787862440.109611:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363520:0@lo:502: 00000040:00080000:2.0:1787862440.109703:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787862440.109715:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787862440.110645:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787862440.110669:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787862440.110677:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862440.110679:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787862440.110700:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862440.110728:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a6533ee8000) 00000020:00000080:2.0:1787862440.110767:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787862440.110778:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787862440.112141:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a651c992800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787862440.112156:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787862440.112165:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c5536ccf892fb91 00010000:00010000:2.0:1787862440.118271:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787862440.118656:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787862440.121589:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787862440.122001:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787862440.126727:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787862440.127425:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787862440.131247:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787862440.131259:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862440.131265:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862440.131267:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787862440.131271:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862440.131275:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862440.131277:0:7624:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787862440.131280:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787862440.131282:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787862440.131323:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862440.131326:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862440.131328:0:7624:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787862440.131331:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787862440.131561:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787862440.131585:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787862440.131610:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.131622:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862440.131643:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a651c992800 from 1 10000000:01000000:1.0:1787862440.131646:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862440.131683:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.131691:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.131703:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.131728:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363648:0@lo:101: 00000100:00100000:1.0:1787862440.131795:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.131965:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.132706:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363648 00000100:00100000:1.0:1787862440.132718:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363648 00000100:00100000:1.0:1787862440.132774:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862440.132783:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:7615:x1874709526363648:12345-0@lo:101: 00010000:00010000:1.0:1787862440.132809:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862440.132825:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fb98 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.132987:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.133000:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.133008:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44800, rc 0) 00000100:00100000:1.0:1787862440.133099:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526363648:12345-0@lo:101: Request processed in 316us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.133107:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862440.133161:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363648:0@lo:101: 00010000:00010000:1.0:1787862440.133176:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.133184:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.133291:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363776:0@lo:501: 00000100:00100000:1.0:1787862440.133324:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.133351:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.133367:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363776 00000100:00100000:1.0:1787862440.133371:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363776 00000100:00100000:1.0:1787862440.133394:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787862440.133400:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526363776:12345-0@lo:501: 00000100:00100000:1.0:1787862440.133717:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526363776:12345-0@lo:501: Request processed in 317us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.133724:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787862440.133759:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363776:0@lo:501: 00000100:00100000:1.0:1787862440.134633:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363904:0@lo:503: 00000100:00100000:1.0:1787862440.134692:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.134724:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.134746:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526363904 00000100:00100000:1.0:1787862440.134752:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526363904 00000100:00100000:1.0:1787862440.134783:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787862440.134810:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526363904:12345-0@lo:503: 00000100:00100000:1.0:1787862440.136326:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526363904:12345-0@lo:503: Request processed in 1511us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.136338:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787862440.137004:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526363904:0@lo:503: 00000040:00080000:3.0:1787862440.137315:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862440.137387:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364032:0@lo:502: 00000100:00100000:3.0:1787862440.137441:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.137487:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.137753:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364032 00000100:00100000:1.0:1787862440.137759:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364032 00000100:00100000:1.0:1787862440.138653:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787862440.138668:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526364032:12345-0@lo:502: 00000100:00100000:1.0:1787862440.139273:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526364032:12345-0@lo:502: Request processed in 608us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.139283:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787862440.139402:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364032:0@lo:502: 00000040:00080000:3.0:1787862440.139764:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787862440.140184:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787862440.140220:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364160:0@lo:502: 00000100:00100000:3.0:1787862440.140270:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.140310:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.140626:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364160 00000100:00100000:1.0:1787862440.140633:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364160 00000100:00100000:1.0:1787862440.140720:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787862440.140729:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526364160:12345-0@lo:502: 00000100:00100000:1.0:1787862440.140931:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526364160:12345-0@lo:502: Request processed in 200us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.140939:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862440.141016:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364160:0@lo:502: 00000040:00080000:3.0:1787862440.141131:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787862440.141142:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787862440.143656:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862440.143672:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862440.143674:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787862440.143681:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a651c992800 00000020:00000080:3.0:1787862440.143691:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862440.143720:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862440.143723:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862440.143724:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787862440.143726:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787862440.143774:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787862440.143797:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862440.143820:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.143852:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862440.143899:0:7615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787862440.143901:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a651c992800 10000000:01000000:3.0:1787862440.143905:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a651c992800 10000000:01000000:3.0:1787862440.143909:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787862440.143914:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a651c992800 from 1 10000000:01000000:3.0:1787862440.143917:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787862440.143966:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.143975:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.143986:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862440.144015:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364288:0@lo:101: 00000100:00100000:3.0:1787862440.144343:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.147179:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056af600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.147409:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364288 00000100:00100000:0.0:1787862440.147420:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364288 00000100:00100000:0.0:1787862440.147470:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787862440.147479:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526364288:12345-0@lo:101: 00010000:00010000:0.0:1787862440.147497:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862440.147519:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fba6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.147624:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.147636:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.147645:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919800, rc 0) 00000100:00100000:0.0:1787862440.147759:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364288:12345-0@lo:101: Request processed in 281us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.147766:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787862440.148288:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364288:0@lo:101: 00010000:00010000:3.0:1787862440.148307:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862440.148317:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862440.148436:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364416:0@lo:501: 00000100:00100000:3.0:1787862440.148472:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.148557:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056af600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.148649:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364416 00000100:00100000:0.0:1787862440.148655:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364416 00000100:00100000:0.0:1787862440.148736:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787862440.148745:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364416:12345-0@lo:501: 00000100:00100000:0.0:1787862440.149454:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364416:12345-0@lo:501: Request processed in 709us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.149463:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862440.149671:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364416:0@lo:501: 00000100:00100000:3.0:1787862440.149711:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364544:0@lo:503: 00000100:00100000:3.0:1787862440.149754:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.149780:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056af600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862440.149809:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364544 00000100:00100000:3.0:1787862440.149814:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364544 00000100:00100000:1.0:1787862440.153643:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862440.154215:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364544:12345-0@lo:503: 00000100:00100000:2.0:1787862440.154475:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364544:12345-0@lo:503: Request processed in 817us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862440.154485:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787862440.155681:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364544:0@lo:503: 00000040:00080000:1.0:1787862440.156382:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862440.156468:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364672:0@lo:502: 00000100:00100000:1.0:1787862440.156544:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.156642:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364672 00000100:00100000:3.0:1787862440.156648:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364672 00000100:00100000:3.0:1787862440.156683:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862440.156693:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364672:12345-0@lo:502: 00000100:00100000:3.0:1787862440.158547:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364672:12345-0@lo:502: Request processed in 1834us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862440.158560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787862440.159237:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598180 going to sleep for 11 seconds 00000100:00100000:2.0:1787862440.159269:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364672:0@lo:502: 00000040:00080000:2.0:1787862440.159656:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787862440.159719:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787862440.159756:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787862440.159821:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787862440.160197:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787862440.160257:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787862440.160293:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787862440.160350:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787862440.160424:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787862440.160463:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787862440.160493:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787862440.160612:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787862440.160649:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787862440.160684:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787862440.160732:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787862440.160770:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787862440.160820:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787862440.163322:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787862440.163402:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787862440.163440:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787862440.163483:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787862440.163513:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787862440.163556:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787862440.163615:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787862440.163647:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787862440.163693:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787862440.163736:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787862440.163766:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787862440.163808:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787862440.164691:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787862440.164745:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787862440.164774:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787862440.164937:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787862440.165254:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787862440.165296:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787862440.165338:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787862440.165373:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787862440.165424:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364800:0@lo:502: 00000100:00100000:2.0:1787862440.165598:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.165698:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862440.165739:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364800 00000100:00100000:1.0:1787862440.165747:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364800 00000100:00100000:1.0:1787862440.166019:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787862440.166030:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364800:12345-0@lo:502: 00000100:00100000:2.0:1787862440.166473:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526364800:12345-0@lo:502: Request processed in 445us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862440.166483:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787862440.166587:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526364800:0@lo:502: 00000040:00080000:0.0:1787862440.166677:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787862440.166689:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787862440.168228:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787862440.168249:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a651c9d4ed8) 00000020:00000080:0.0:1787862440.168274:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787862440.168347:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a651c992800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787862440.168351:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a651c992800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787862440.168354:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a651c992800 3 00010000:00080000:0.0:1787862440.168384:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a651c994800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1787862440.172415:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787862440.172708:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787862440.172755:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787862440.172773:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c5536ccf892fbbb 00000100:00080000:1.0:1787862440.172784:0:7629:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787862440.172804:0:7629:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a651c994800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862440.173242:0:7629:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6518ee9a40 x1874709526364928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862440.173304:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526364928:0@lo:38: 00000100:00100000:3.0:1787862440.173411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862440.173516:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526364928 00000100:00100000:0.0:1787862440.173535:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526364928 00000100:00100000:0.0:1787862440.173569:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862440.173577:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526364928:12345-0@lo:38: 00010000:00080000:0.0:1787862440.173602:0:5815:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1787862440.173635:0:5815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c5536ccf892fbc2 00000004:00100000:0.0:1787862440.173650:0:5815:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787862440.173686:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9a65402fa800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787862440.173743:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787862440.176663:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526365312:0@lo:400: 00000100:00100000:2.0:1787862440.176731:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.176789:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365312 00000100:00100000:2.0:1787862440.176796:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365312 00000100:00100000:2.0:1787862440.176862:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862440.176871:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526365312:12345-0@lo:400: 00000100:00100000:2.0:1787862440.176923:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526365312:12345-0@lo:400: Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862440.176930:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787862440.178887:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862440.179180:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64031992c0 x1874709526365312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862440.179215:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526365312:0@lo:400: 00000100:00100000:0.0:1787862440.181663:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874709526364928:12345-0@lo:38: Request processed in 8076us (8243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.181677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862440.181729:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526365056:0@lo:400: 00000100:00100000:0.0:1787862440.181943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862440.182147:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862440.182155:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526365184:0@lo:400: 00000100:00100000:0.0:1787862440.182183:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862440.182223:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365056 00000100:00100000:0.0:1787862440.182231:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365056 00000100:00100000:0.0:1787862440.182271:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365184 00000100:00100000:0.0:1787862440.182275:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365184 00000100:00100000:0.0:1787862440.182304:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862440.182317:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526365056:12345-0@lo:400: 00000100:00100000:0.0:1787862440.182371:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526365056:12345-0@lo:400: Request processed in 59us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.182377:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862440.182389:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862440.182395:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526365184:12345-0@lo:400: 00000100:00100000:0.0:1787862440.182422:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526365184:12345-0@lo:400: Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.182427:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787862440.182463:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a651682b480 x1874709526365184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862440.182475:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526365184:0@lo:400: 00010000:00080000:0.0:1787862440.182485:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6516829e00 x1874709526365056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862440.182492:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526365056:0@lo:400: 00000100:00080000:0.0:1787862440.182518:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787862440.183804:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518ee9a40 x1874709526364928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862440.183848:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862440.183859:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787862440.183869:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787862440.183874:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787862440.183878:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787862440.183886:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526364928:0@lo:38: 00000040:00080000:0.0:1787862440.185729:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787862440.186233:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787862440.186265:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787862440.186292:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.186306:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787862440.186353:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787862440.186356:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787862440.186357:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862440.186359:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862440.186360:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862440.186361:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862440.186364:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862440.186365:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862440.186367:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862440.186369:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862440.186370:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787862440.186374:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787862440.186377:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787862440.186378:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787862440.186379:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862440.186386:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862440.186387:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862440.186388:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862440.186389:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862440.186390:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787862440.186391:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787862440.186392:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862440.186393:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787862440.186431:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787862440.186451:0:7615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526365440:0@lo:253: 00000100:00100000:1.0:1787862440.186522:0:7615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862440.186574:0:7615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.186689:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365440 00000100:00100000:0.0:1787862440.186696:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365440 00000100:00100000:0.0:1787862440.186756:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862440.186766:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7615:x1874709526365440:12345-0@lo:253: 20000000:01000000:0.0:1787862440.186802:0:5808:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787862440.186817:0:5808:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787862440.187685:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1874709526365568:0@lo:901: 00000100:00100000:3.0:1787862440.187737:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862440.187760:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056afa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.188338:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365568 00000100:00100000:0.0:1787862440.188346:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365568 00000100:00100000:0.0:1787862440.188398:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862440.188408:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1874709526365568:12345-0@lo:901: 00000100:00100000:0.0:1787862440.188696:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1874709526365568:12345-0@lo:901: Request processed in 289us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.188704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787862440.188773:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787862440.188977:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6518ec7840 x1874709526365568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787862456 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862440.188993:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1874709526365568:0@lo:901: 20000000:01000000:0.0:1787862440.218028:0:5808:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787862440.218072:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787862440.218634:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787862440.218639:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787862440.218664:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.218684:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.218693:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.218737:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862440.218753:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 14 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862440.218769:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874709526365696:0@lo:104: 00000100:00100000:2.0:1787862440.218850:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.218901:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862440.219204:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365696 00000100:00100000:0.0:1787862440.219213:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365696 00000100:00100000:0.0:1787862440.219265:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862440.219275:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5831:x1874709526365696:12345-0@lo:104: 00010000:00010000:0.0:1787862440.219288:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.219344:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862440.219350:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:5831:x1874709526365696:12345-0@lo:104: Request processed in 77us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862440.219356:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787862440.219378:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862440.219383:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.219402:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862440.219406:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.219414:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862440.219421:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862440.219427:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787862440.219452:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.219459:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862440.219476:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.219483:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfce00/0x9c5536ccf892fb13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb1a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862440.219499:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.219501:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862440.219503:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862440.219514:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526365824:0@lo:103: 00000100:00100000:0.0:1787862440.219562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862440.219615:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874709526365696:0@lo:104: 00010000:00010000:0.0:1787862440.219632:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.222221:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365824 00000100:00100000:1.0:1787862440.222237:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365824 00010000:00010000:1.0:1787862440.222277:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 15 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.222308:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787862440.222319:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:3282:x1874709526365824:12345-0@lo:103: 00010000:00010000:1.0:1787862440.222334:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862440.222340:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 15 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222353:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 15 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222371:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fb1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fb13 expref: 15 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222394:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222402:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787862440.222430:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008262755s 00010000:00010000:1.0:1787862440.222435:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222442:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222448:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222454:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222459:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862440.222463:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222470:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222487:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222497:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862440.222584:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3282:x1874709526365824:12345-0@lo:103: Request processed in 266us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.222591:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787862440.222649:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222666:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862440.222672:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfc200/0x9c5536ccf892fbc9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862440.222707:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526365824:0@lo:103: 00000100:00100000:1.0:1787862440.231243:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:7615:x1874709526365440:12345-0@lo:253: Request processed in 44467us (44709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862440.231263:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787862440.231441:0:7615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43a6d3ac-1408-47c4-9e06-195b8e037a27:7615:1874709526365440:0@lo:253: 10000000:01000000:0.0:1787862440.231460:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787862440.231465:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862440.231467:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862440.231468:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862440.231470:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862440.231471:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862440.231473:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862440.231474:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862440.231476:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787862440.231478:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787862440.231479:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862440.231481:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787862440.231504:0:7615:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787862440.237923:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862440.238271:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787862440.238485:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787862440.238742:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862440.239592:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862440.239732:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787862440.243237:0:7615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787862440.479713:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787862440.537761:0:7615:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787862440.537768:0:7615:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787862440.537833:0:7615:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787862440.537901:0:7615:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787862440.537914:0:7615:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787862440.537942:0:7615:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1787862440.605681:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862440.605708:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526365952:0@lo:13: 00000100:00100000:1.0:1787862440.605783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862440.605889:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526365952 00000100:00100000:2.0:1787862440.605898:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526365952 00000100:00100000:2.0:1787862440.605955:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862440.605964:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526365952:12345-0@lo:13: 00002000:00000024:2.0:1787862440.606003:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862440.606084:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526365952:12345-0@lo:13: Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862440.606091:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787862440.606178:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a640319ad00 x1874709526365952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862440.606203:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526365952:0@lo:13: 00010000:00010000:3.0:1787862441.501903:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862442.526155:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862443.551549:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862444.572382:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862445.219209:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526366464:0@lo:400: 00000100:00100000:3.0:1787862445.219341:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862445.219435:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787862445.219443:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526366080:0@lo:400: 00000100:00100000:3.0:1787862445.219478:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862445.219516:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526366592:0@lo:400: 00000100:00100000:2.0:1787862445.219521:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366080 00000100:00100000:2.0:1787862445.219533:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366080 00000100:00100000:3.0:1787862445.219546:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862445.219596:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526366208:0@lo:400: 00000100:00100000:2.0:1787862445.219602:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787862445.219614:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3283:x1874709526366080:12345-0@lo:400: 00000100:00100000:2.0:1787862445.219681:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3283:x1874709526366080:12345-0@lo:400: Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862445.219690:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787862445.222453:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862445.222555:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862445.222588:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526366336:0@lo:400: 00000100:00100000:3.0:1787862445.223414:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862445.223483:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366464 00000100:00100000:3.0:1787862445.223495:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366464 00000100:00100000:3.0:1787862445.223585:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862445.223591:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366592 00000100:00100000:1.0:1787862445.223597:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366592 00000100:00100000:3.0:1787862445.223601:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526366464:12345-0@lo:400: 00000100:00100000:1.0:1787862445.223636:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366208 00000100:00100000:1.0:1787862445.223640:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366208 00000100:00100000:1.0:1787862445.223657:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366336 00000100:00100000:1.0:1787862445.223659:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366336 00000100:00100000:1.0:1787862445.223678:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787862445.223687:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526366592:12345-0@lo:400: 00000100:00100000:1.0:1787862445.223755:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526366592:12345-0@lo:400: Request processed in 69us (4207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862445.223765:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787862445.223823:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862445.223831:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526366208:12345-0@lo:400: 00000100:00100000:1.0:1787862445.223952:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526366208:12345-0@lo:400: Request processed in 123us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862445.223960:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862445.223974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787862445.223982:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526366336:12345-0@lo:400: 00000100:00100000:1.0:1787862445.224013:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526366336:12345-0@lo:400: Request processed in 33us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862445.224020:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787862445.224304:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec6940 x1874709526366336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862445.224322:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526366336:0@lo:400: 00010000:00080000:1.0:1787862445.224340:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec5680 x1874709526366208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862445.224364:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526366208:0@lo:400: 00000100:00100000:1.0:1787862445.225737:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526366080:0@lo:400: 00010000:00080000:1.0:1787862445.225768:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518f0ad00 x1874709526366592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862445.225792:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526366592:0@lo:400: 00000100:00100000:3.0:1787862445.227207:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526366464:12345-0@lo:400: Request processed in 3603us (7858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862445.227236:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787862445.228030:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec7480 x1874709526366464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862445.228069:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526366464:0@lo:400: 00000100:00080000:3.0:1787862445.229202:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862445.229410:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862445.596443:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862445.731086:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526366720:0@lo:13: 00000100:00100000:0.0:1787862445.731192:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862445.731303:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366720 00000100:00100000:0.0:1787862445.731312:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366720 00000100:00100000:0.0:1787862445.731371:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862445.731382:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526366720:12345-0@lo:13: 00002000:00000024:0.0:1787862445.731440:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862445.731493:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526366720:12345-0@lo:13: Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862445.731501:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787862445.731544:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a640319bc00 x1874709526366720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862445.731565:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526366720:0@lo:13: 00010000:00010000:2.0:1787862446.620541:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862447.645558:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862448.621776:0:7973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787862448.669543:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787862448.802825:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787862448.802836:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a653d6d2000 from 30 10000000:01000000:0.0:1787862448.802844:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787862448.802893:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.802906:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.802917:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862448.802942:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526366848:0@lo:101: 00000100:00100000:0.0:1787862448.803019:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.803090:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.807110:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366848 00000100:00100000:0.0:1787862448.807127:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366848 00000100:00100000:0.0:1787862448.807192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862448.807203:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526366848:12345-0@lo:101: 00010000:00010000:0.0:1787862448.807220:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862448.807237:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fbd0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.807263:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.807273:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.807299:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918a00, rc 0) 00000100:00100000:0.0:1787862448.807368:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526366848:12345-0@lo:101: Request processed in 167us (4349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.807375:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787862448.807439:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526366848:0@lo:101: 00010000:00010000:0.0:1787862448.807455:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.807464:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862448.807727:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526366976:0@lo:501: 00000100:00100000:0.0:1787862448.807770:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.807801:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.808357:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526366976 00000100:00100000:1.0:1787862448.808363:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526366976 00000100:00100000:1.0:1787862448.808403:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787862448.808412:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526366976:12345-0@lo:501: 00000100:00100000:1.0:1787862448.808976:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526366976:12345-0@lo:501: Request processed in 566us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.808984:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787862448.810722:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526366976:0@lo:501: 00000100:00100000:3.0:1787862448.810798:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367104:0@lo:503: 00000100:00100000:3.0:1787862448.810865:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862448.810903:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65347ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.811492:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367104 00000100:00100000:0.0:1787862448.811501:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367104 00000100:00100000:0.0:1787862448.811561:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787862448.811578:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526367104:12345-0@lo:503: 00000100:00100000:0.0:1787862448.811960:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526367104:12345-0@lo:503: Request processed in 390us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.811968:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787862448.813116:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367104:0@lo:503: 00000100:00100000:3.0:1787862448.815279:0:7980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7980:1874709526367232:0@lo:502: 00000100:00100000:3.0:1787862448.815360:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862448.815412:0:7980:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65347adb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.815519:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367232 00000100:00100000:0.0:1787862448.815526:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367232 00000100:00100000:0.0:1787862448.815585:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787862448.815596:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7980:x1874709526367232:12345-0@lo:502: 00000100:00100000:0.0:1787862448.815955:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7980:x1874709526367232:12345-0@lo:502: Request processed in 359us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.815970:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787862448.816384:0:7980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7980:1874709526367232:0@lo:502: 00000100:00100000:1.0:1787862448.816516:0:7980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7980:1874709526367360:0@lo:502: 00000100:00100000:1.0:1787862448.816566:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.816601:0:7980:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862448.816818:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367360 00000100:00100000:2.0:1787862448.816824:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367360 00000100:00100000:2.0:1787862448.816935:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787862448.816944:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7980:x1874709526367360:12345-0@lo:502: 00000100:00100000:2.0:1787862448.817619:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:7980:x1874709526367360:12345-0@lo:502: Request processed in 675us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862448.817628:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787862448.817816:0:7980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7980:1874709526367360:0@lo:502: 00000040:00080000:1.0:1787862448.817921:0:7980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787862448.818240:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787862448.818260:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862448.818271:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862448.818283:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862448.818370:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787862448.818373:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787862448.818376:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787862448.818406:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862448.818414:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862448.818424:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862448.818441:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f08780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367488:0@lo:101: 00000100:00100000:3.0:1787862448.818550:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862448.818611:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65347add80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.818723:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367488 00000100:00100000:1.0:1787862448.818736:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367488 00000100:00100000:1.0:1787862448.820601:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787862448.820622:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526367488:12345-0@lo:101: 00010000:00010000:1.0:1787862448.820639:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862448.820670:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fbde expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862448.820699:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862448.820714:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862448.820723:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45c00, rc 0) 00000100:00100000:1.0:1787862448.820824:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526367488:12345-0@lo:101: Request processed in 210us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862448.820950:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f08780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367488:0@lo:101: 00010000:00010000:2.0:1787862448.820967:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.820977:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862448.821066:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367616:0@lo:501: 00000100:00100000:2.0:1787862448.821107:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.821224:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787862448.821433:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.821487:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367616 00000100:00100000:1.0:1787862448.821493:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367616 00000100:00100000:1.0:1787862448.821513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787862448.821518:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526367616:12345-0@lo:501: 00000100:00100000:1.0:1787862448.821804:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526367616:12345-0@lo:501: Request processed in 284us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.821811:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787862448.822066:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367616:0@lo:501: 00000100:00100000:1.0:1787862448.822102:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367744:0@lo:503: 00000100:00100000:1.0:1787862448.822142:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.822157:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.822176:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367744 00000100:00100000:1.0:1787862448.822180:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367744 00000100:00100000:1.0:1787862448.822197:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787862448.822203:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526367744:12345-0@lo:503: 00000100:00100000:1.0:1787862448.822548:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526367744:12345-0@lo:503: Request processed in 343us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.822555:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787862448.822594:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526367744:0@lo:503: 00000100:00100000:1.0:1787862448.824664:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7981:1874709526367872:0@lo:502: 00000100:00100000:1.0:1787862448.824740:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.824941:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526367872 00000100:00100000:0.0:1787862448.824948:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526367872 00000100:00100000:0.0:1787862448.824989:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787862448.824998:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:7981:x1874709526367872:12345-0@lo:502: 00000100:00100000:0.0:1787862448.825391:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:7981:x1874709526367872:12345-0@lo:502: Request processed in 391us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.825399:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787862448.825532:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.825552:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7981:1874709526367872:0@lo:502: 00000020:01000000:1.0:1787862448.825580:0:7981:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862448.825589:0:7981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862448.825592:0:7981:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862448.825597:0:7981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862448.825599:0:7981:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787862448.825617:0:7981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7981:1874709526368000:0@lo:502: 00000100:00100000:1.0:1787862448.825664:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.825689:0:7981:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.825829:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368000 00000100:00100000:0.0:1787862448.825902:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368000 00000100:00100000:0.0:1787862448.825937:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787862448.825945:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:7981:x1874709526368000:12345-0@lo:502: 00000100:00100000:0.0:1787862448.826106:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:7981:x1874709526368000:12345-0@lo:502: Request processed in 161us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.826113:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787862448.826201:0:7981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7981:1874709526368000:0@lo:502: 00000020:01000000:1.0:1787862448.826222:0:7981:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862448.826226:0:7981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862448.826228:0:7981:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787862448.826231:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787862448.826378:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787862448.826405:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787862448.826416:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826427:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862448.826437:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787862448.826441:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a65091a1800 from 30 10000000:01000000:0.0:1787862448.826512:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787862448.826540:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826560:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826569:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862448.826583:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368128:0@lo:101: 00000100:00100000:0.0:1787862448.826616:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.826634:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.826662:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368128 00000100:00100000:0.0:1787862448.826666:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368128 00000100:00100000:0.0:1787862448.826691:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862448.826698:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526368128:12345-0@lo:101: 00010000:00010000:0.0:1787862448.826708:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862448.826721:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fbec expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826742:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826810:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826819:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919400, rc 0) 00000100:00100000:0.0:1787862448.826916:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526368128:12345-0@lo:101: Request processed in 219us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.826922:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862448.826950:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368128:0@lo:101: 00010000:00010000:0.0:1787862448.826967:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.826975:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862448.827013:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368256:0@lo:501: 00000100:00100000:0.0:1787862448.827034:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.827071:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.827084:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368256 00000100:00100000:0.0:1787862448.827088:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368256 00000100:00100000:0.0:1787862448.827109:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787862448.827115:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526368256:12345-0@lo:501: 00000100:00100000:0.0:1787862448.827722:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526368256:12345-0@lo:501: Request processed in 606us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.827731:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787862448.827926:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368256:0@lo:501: 00000100:00100000:1.0:1787862448.827959:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368384:0@lo:503: 00000100:00100000:1.0:1787862448.828006:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.828085:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.828152:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368384 00000100:00100000:0.0:1787862448.828157:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368384 00000100:00100000:0.0:1787862448.828231:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862448.828239:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526368384:12345-0@lo:503: 00000100:00100000:0.0:1787862448.828544:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526368384:12345-0@lo:503: Request processed in 306us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.828551:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862448.835169:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368384:0@lo:503: 00000100:00100000:0.0:1787862448.835723:0:7983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feabc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7983:1874709526368512:0@lo:502: 00000100:00100000:0.0:1787862448.835809:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.835891:0:7983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862448.839312:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368512 00000100:00100000:3.0:1787862448.839325:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368512 00000100:00100000:3.0:1787862448.839732:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787862448.839754:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:7983:x1874709526368512:12345-0@lo:502: 00000100:00100000:3.0:1787862448.840107:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:7983:x1874709526368512:12345-0@lo:502: Request processed in 364us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862448.840116:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787862448.842842:0:7983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feabc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7983:1874709526368512:0@lo:502: 00000100:00100000:0.0:1787862448.842937:0:7983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feabc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7983:1874709526368640:0@lo:502: 00000100:00100000:0.0:1787862448.843007:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.843088:0:7983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.846202:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368640 00000100:00100000:1.0:1787862448.846218:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368640 00000100:00100000:1.0:1787862448.846276:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787862448.846285:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:7983:x1874709526368640:12345-0@lo:502: 00000100:00100000:1.0:1787862448.847024:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:7983:x1874709526368640:12345-0@lo:502: Request processed in 736us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.847033:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787862448.851148:0:7983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feabc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7983:1874709526368640:0@lo:502: 00000040:00080000:3.0:1787862448.851533:0:7983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787862448.851811:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787862448.851956:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862448.851968:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.851979:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862448.851988:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787862448.851991:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a65091a1800 from 5 10000000:01000000:2.0:1787862448.851993:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862448.852027:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.852036:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.852217:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862448.852925:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368768:0@lo:101: 00000100:00100000:3.0:1787862448.853001:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862448.853330:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65347ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862448.853423:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368768 00000100:00100000:1.0:1787862448.853432:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368768 00000100:00100000:1.0:1787862448.853592:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787862448.853603:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526368768:12345-0@lo:101: 00010000:00010000:1.0:1787862448.853736:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862448.853778:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af45a00/0x9c5536ccf892fc01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fbfa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862448.853805:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af45a00/0x9c5536ccf892fc01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fbfa expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862448.853817:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af45a00/0x9c5536ccf892fc01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbfa expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862448.853825:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45a00, rc 0) 00000100:00100000:1.0:1787862448.853946:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526368768:12345-0@lo:101: Request processed in 345us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.853954:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787862448.854036:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368768:0@lo:101: 00010000:00010000:3.0:1787862448.854079:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862448.854089:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862448.854138:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f08780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368896:0@lo:256: 00000100:00100000:3.0:1787862448.854167:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862448.854326:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65347ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862448.854415:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526368896 00000100:00100000:2.0:1787862448.854420:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526368896 00000100:00100000:2.0:1787862448.854624:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862448.854633:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526368896:12345-0@lo:256: 20000000:01000000:2.0:1787862448.854657:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787862448.854672:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787862448.854675:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787862448.854779:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526368896:12345-0@lo:256: Request processed in 148us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862448.854792:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862448.855117:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f08780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526368896:0@lo:256: 10000000:01000000:2.0:1787862448.855167:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862448.855175:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855186:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862448.855195:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787862448.855198:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787862448.855200:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787862448.855223:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855231:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855239:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862448.855254:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526369024:0@lo:101: 00000100:00100000:2.0:1787862448.855284:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862448.855383:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862448.855398:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369024 00000100:00100000:2.0:1787862448.855402:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369024 00000100:00100000:2.0:1787862448.855424:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862448.855430:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526369024:12345-0@lo:101: 00010000:00010000:2.0:1787862448.855519:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862448.855531:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fc08 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855548:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855558:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855565:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd400, rc 0) 00000100:00100000:2.0:1787862448.855597:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526369024:12345-0@lo:101: Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862448.855604:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862448.855816:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526369024:0@lo:101: 00010000:00010000:2.0:1787862448.855829:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862448.855907:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862448.855955:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526369152:0@lo:501: 00000100:00100000:2.0:1787862448.855982:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862448.855998:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862448.856011:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369152 00000100:00100000:2.0:1787862448.856015:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369152 00000100:00100000:2.0:1787862448.856033:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862448.856039:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526369152:12345-0@lo:501: 00000100:00100000:2.0:1787862448.857027:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526369152:12345-0@lo:501: Request processed in 984us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862448.857036:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787862448.857244:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526369152:0@lo:501: 00000100:00100000:1.0:1787862448.857285:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526369280:0@lo:503: 00000100:00100000:1.0:1787862448.857393:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.857525:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787862448.857567:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369280 00000100:00100000:2.0:1787862448.857573:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369280 00000100:00100000:2.0:1787862448.857822:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787862448.857903:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526369280:12345-0@lo:503: 00000100:00100000:2.0:1787862448.858274:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526369280:12345-0@lo:503: Request processed in 443us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862448.858281:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787862448.858427:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526369280:0@lo:503: 00000100:00100000:1.0:1787862448.859095:0:7985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7985:1874709526369408:0@lo:502: 00000100:00100000:1.0:1787862448.859144:0:7985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.859175:0:7985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862448.859238:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369408 00000100:00100000:3.0:1787862448.859243:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369408 00000100:00100000:3.0:1787862448.859868:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787862448.859878:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:7985:x1874709526369408:12345-0@lo:502: 00000100:00100000:3.0:1787862448.860274:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:7985:x1874709526369408:12345-0@lo:502: Request processed in 298us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862448.860284:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787862448.867963:0:7985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7985:1874709526369408:0@lo:502: 00000020:01000000:1.0:1787862448.868011:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787862448.868020:0:7985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787862448.868028:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862448.868030:0:7985:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787862448.868035:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787862448.868039:0:7985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:1.0:1787862448.868078:0:7985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787862448.868081:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787862448.870760:0:7985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6526ce4ed8) 00000020:00000080:1.0:1787862448.870788:0:7985:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787862448.870801:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787862448.870896:0:7985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787862448.870902:0:7985:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787862448.870908:0:7985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf892fc1d 00010000:00080000:1.0:1787862448.870938:0:7985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a65403ab800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:1.0:1787862448.871266:0:7985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787862448.872207:0:7985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787862448.872223:0:7985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787862448.872825:0:7985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862448.879431:0:7985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862448.879544:0:7985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787862448.881285:0:7985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787862448.899766:0:7988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862448.899776:0:7988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787862448.900880:0:7985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787862448.900895:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787862448.900929:0:7985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787862448.900953:0:7985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf892fc24 00000100:00080000:1.0:1787862448.900964:0:7985:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787862448.900971:0:7985:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a65403ab800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862448.901008:0:7985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6518ee9680 x1874709526369536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787862448.901038:0:7985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787862448.901196:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862448.901201:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862448.901203:0:7985:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787862448.901207:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862448.901211:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862448.901213:0:7985:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862448.901216:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862448.901218:0:7985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787862448.901251:0:7985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7985:1874709526369664:0@lo:502: 00000100:00100000:1.0:1787862448.901413:0:7985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.901522:0:7985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.901653:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526370176:0@lo:400: 00000100:00100000:0.0:1787862448.901694:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.901721:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862448.901728:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526369792:0@lo:400: 00000100:00100000:0.0:1787862448.901760:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.901795:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370176 00000100:00100000:3.0:1787862448.901798:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526369536:0@lo:8: 00000100:00100000:0.0:1787862448.901802:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370176 00000100:00100000:3.0:1787862448.901848:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.901859:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369792 00000100:00100000:0.0:1787862448.901863:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369792 00000100:00100000:0.0:1787862448.901896:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787862448.901907:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369536 00000100:00100000:0.0:1787862448.901907:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526370176:12345-0@lo:400: 00000100:00100000:3.0:1787862448.901914:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369536 00000100:00100000:3.0:1787862448.901945:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862448.901954:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874709526369536:12345-0@lo:8: 00000100:00100000:0.0:1787862448.901965:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526370176:12345-0@lo:400: Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.901973:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787862448.901979:0:6672:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000100:00100000:0.0:1787862448.901993:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862448.902001:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526369792:12345-0@lo:400: 00000020:00000080:3.0:1787862448.902011:0:6672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf892fc2b 00002000:00100000:3.0:1787862448.902029:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a651f8d1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:0.0:1787862448.902033:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526369792:12345-0@lo:400: Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.902058:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00080000:3.0:1787862448.902065:0:6672:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787862448.902070:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787862448.902078:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862448.902110:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ee9a40 x1874709526369792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862448.902134:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526369792:0@lo:400: 00010000:00080000:0.0:1787862448.902147:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec5680 x1874709526370176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862448.902155:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526370176:0@lo:400: 00000100:00100000:1.0:1787862448.902185:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369664 00000100:00100000:1.0:1787862448.902191:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369664 00000100:00100000:1.0:1787862448.902222:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787862448.902230:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:7985:x1874709526369664:12345-0@lo:502: 00002000:00100000:3.0:1787862448.902547:0:6672:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787862448.902836:0:6672:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787862448.902861:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9a651f8d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862448.902911:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1874709526369536:12345-0@lo:8: Request processed in 957us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862448.902919:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787862448.902969:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ee9680 x1874709526369536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862448.902979:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862448.902985:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787862448.902992:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787862448.902997:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787862448.902999:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65403ab800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787862448.903008:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787862448.903013:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526369536:0@lo:8: 00000004:00080000:3.0:1787862448.903032:0:7988:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787862448.903887:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:7985:x1874709526369664:12345-0@lo:502: Request processed in 1655us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.903896:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787862448.903961:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526369920:0@lo:400: 00000100:00100000:1.0:1787862448.903997:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.904034:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862448.904063:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526370048:0@lo:400: 00000100:00100000:0.0:1787862448.904064:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526369920 00000100:00100000:0.0:1787862448.904072:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526369920 00000100:00100000:0.0:1787862448.904128:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862448.904137:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526369920:12345-0@lo:400: 00000004:00080000:3.0:1787862448.904830:0:7988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 174668785717ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787862448.906204:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526369920:12345-0@lo:400: Request processed in 2062us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.906216:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787862448.906628:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862448.910139:0:7985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:7985:1874709526369664:0@lo:502: 00000020:01000000:0.0:1787862448.910183:0:7985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862448.910192:0:7985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862448.910194:0:7985:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787862448.910199:0:7985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787862448.910318:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787862448.910337:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787862448.910346:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.910358:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862448.910369:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787862448.910372:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a653aa2b490 from 1 10000000:01000000:0.0:1787862448.911527:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787862448.911630:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.911642:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.911653:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862448.911677:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526370304:0@lo:101: 00000100:00100000:0.0:1787862448.911761:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.911810:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.911836:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370304 00000100:00100000:0.0:1787862448.911843:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370304 00000100:00100000:0.0:1787862448.911894:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787862448.911903:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526370304:12345-0@lo:101: 00010000:00010000:0.0:1787862448.911916:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862448.911928:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fc32 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.911950:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.911961:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.911969:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918e00, rc 0) 00000100:00100000:0.0:1787862448.912005:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526370304:12345-0@lo:101: Request processed in 102us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862448.912024:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787862448.912084:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526370304:0@lo:101: 00010000:00010000:0.0:1787862448.912097:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.912106:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862448.912148:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526370432:0@lo:501: 00000100:00100000:0.0:1787862448.912172:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862448.912187:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862448.912199:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370432 00000100:00100000:0.0:1787862448.912202:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370432 00000100:00100000:0.0:1787862448.912223:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787862448.912229:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526370432:12345-0@lo:501: 00000100:00100000:0.0:1787862448.913645:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526370432:12345-0@lo:501: Request processed in 1340us (1395us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787862448.913658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787862448.913712:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526370432:0@lo:501: 10000000:01000000:0.0:1787862448.913741:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787862448.913759:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862448.913770:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862448.918185:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862448.918764:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370048 00000100:00100000:1.0:1787862448.918775:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370048 00000100:00100000:1.0:1787862448.918838:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862448.918849:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526370048:12345-0@lo:400: 00000100:00100000:1.0:1787862448.918918:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526370048:12345-0@lo:400: Request processed in 71us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862448.918927:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787862448.918972:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec7840 x1874709526370048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862448.918988:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526370048:0@lo:400: 00010000:00080000:1.0:1787862448.919002:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec7480 x1874709526369920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862448.919012:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526369920:0@lo:400: 00000100:00080000:0.0:1787862448.919533:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787862449.002605:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787862449.053948:0:7989:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787862449.053984:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526370688:0@lo:7: 00000100:00100000:1.0:1787862449.054104:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862449.054158:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509c316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862449.054222:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526370560:0@lo:13: 00000100:00100000:2.0:1787862449.054256:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862449.054337:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370560 00000100:00100000:1.0:1787862449.054344:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370560 00000100:00100000:1.0:1787862449.054404:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862449.054414:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526370560:12345-0@lo:13: 00002000:00000024:1.0:1787862449.054467:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787862449.054517:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526370560:12345-0@lo:13: Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862449.054524:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787862449.054565:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec7480 x1874709526370560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862449.054582:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526370560:0@lo:13: 00000100:00080000:2.0:1787862449.054736:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862449.054774:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370688 00000100:00100000:3.0:1787862449.054780:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370688 00000100:00100000:3.0:1787862449.054822:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862449.054844:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7989:x1874709526370688:12345-0@lo:7: 00002000:00080000:2.0:1787862449.075510:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787862449.075518:0:6671:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787862449.075627:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7989:x1874709526370688:12345-0@lo:7: Request processed in 20782us (21519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862449.075638:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787862449.075927:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec7840 x1874709526370688/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787862465 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862449.075942:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526370688:0@lo:7: 00000004:00080000:0.0:1787862449.075958:0:7989:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787862449.075999:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526370816:0@lo:5: 00000100:00100000:0.0:1787862449.076038:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862449.076107:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862449.077813:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370816 00000100:00100000:3.0:1787862449.077827:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370816 00000100:00100000:3.0:1787862449.077904:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862449.077915:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7989:x1874709526370816:12345-0@lo:5: 00002000:00080000:3.0:1787862449.077956:0:6672:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787862449.077960:0:6672:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787862449.078652:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7989:x1874709526370816:12345-0@lo:5: Request processed in 736us (2611us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787862449.078663:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787862449.078720:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fea9a40 x1874709526370816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862465 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862449.078736:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526370816:0@lo:5: 00000004:00080000:3.0:1787862449.078767:0:7989:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787862449.078805:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526370944:0@lo:700: 00000100:00100000:3.0:1787862449.078846:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862449.078898:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862449.078924:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526370944 00000100:00100000:3.0:1787862449.078929:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526370944 00000100:00100000:3.0:1787862449.078971:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862449.078982:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7989:x1874709526370944:12345-0@lo:700: 00000100:00100000:3.0:1787862449.079016:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a650a17ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6678:1874709526371072:0@lo:700: 00000100:00100000:3.0:1787862449.079089:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862449.079116:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862449.082364:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371072 00000100:00100000:2.0:1787862449.082383:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371072 00000100:00100000:2.0:1787862449.082451:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862449.082464:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6678:x1874709526371072:12345-0@lo:700: 40000000:02000000:2.0:1787862449.136566:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787862449.142005:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6678:x1874709526371072:12345-0@lo:700: Request processed in 59535us (62909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862449.142020:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787862449.142202:0:6678:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a650a17ed00 x1874709526371072/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787862465 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862449.142218:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a650a17ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6678:1874709526371072:0@lo:700: 40000000:02000000:3.0:1787862449.142231:0:6678:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1787862449.249493:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7989:x1874709526370944:12345-0@lo:700: Request processed in 170506us (170641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862449.249513:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1787862449.249634:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787862449.249645:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787862449.250107:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518f0ad00 x1874709526370944/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787862465 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862449.250146:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526370944:0@lo:700: 00000004:02000040:2.0:1787862449.292112:0:7989:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787862449.305007:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526371200:0@lo:5: 00000100:00100000:2.0:1787862449.305104:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862449.305140:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371200 00000100:00100000:2.0:1787862449.305146:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371200 00000100:00100000:2.0:1787862449.305186:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862449.305194:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7989:x1874709526371200:12345-0@lo:5: 00000100:00100000:3.0:1787862449.318163:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b900 going to sleep for 11 seconds 00002000:00080000:2.0:1787862449.325204:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787862449.325231:0:6671:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787862449.330410:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7989:x1874709526371200:12345-0@lo:5: Request processed in 25209us (25298us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787862449.330424:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787862449.331211:0:7989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6403198780 x1874709526371200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862465 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862449.331226:0:7989:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787862449.331241:0:7989:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6403198780 x1874709526371200/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787862465 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862449.331253:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7989:1874709526371200:0@lo:5: 00000004:00080000:3.0:1787862449.331267:0:7989:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787862449.692198:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862450.716401:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862450.844555:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526371328:0@lo:13: 00000100:00100000:1.0:1787862450.844630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862450.844941:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371328 00000100:00100000:2.0:1787862450.844950:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371328 00000100:00100000:2.0:1787862450.845012:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787862450.845022:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526371328:12345-0@lo:13: 00002000:00000024:2.0:1787862450.845086:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862450.845135:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526371328:12345-0@lo:13: Request processed in 115us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862450.845141:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787862450.845255:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a640319b0c0 x1874709526371328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862450.845272:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526371328:0@lo:13: 00000100:00080000:0.0:1787862450.845390:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862451.740463:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862452.764746:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787862453.648197:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787862453.798415:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862453.932078:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526371840:0@lo:400: 00000100:00100000:3.0:1787862453.932181:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862453.932244:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787862453.932252:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526371456:0@lo:400: 00000100:00100000:3.0:1787862453.932283:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862453.932307:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526371968:0@lo:400: 00000100:00100000:3.0:1787862453.932332:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862453.932378:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371840 00000100:00100000:3.0:1787862453.932385:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371840 00000100:00100000:3.0:1787862453.932556:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862453.932582:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526371840:12345-0@lo:400: 00000100:00100000:3.0:1787862453.932642:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526371840:12345-0@lo:400: Request processed in 62us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862453.932650:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787862453.932714:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651faea580 x1874709526371840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862453.932730:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526371840:0@lo:400: 00000100:00100000:0.0:1787862453.935370:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526371584:0@lo:400: 00000100:00100000:0.0:1787862453.935464:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862453.935507:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526372096:0@lo:400: 00000100:00100000:0.0:1787862453.935535:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862453.935562:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862453.935569:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526371712:0@lo:400: 00000100:00100000:0.0:1787862453.935594:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862453.935633:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371456 00000100:00100000:0.0:1787862453.935642:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371456 00000100:00100000:0.0:1787862453.935715:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787862453.935727:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526371456:12345-0@lo:400: 00000100:00100000:0.0:1787862453.935791:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526371456:12345-0@lo:400: Request processed in 66us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862453.935809:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787862453.935846:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371968 00000100:00100000:0.0:1787862453.935851:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371968 00000100:00100000:0.0:1787862453.935880:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371584 00000100:00100000:0.0:1787862453.935884:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371584 00000100:00100000:0.0:1787862453.935894:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526371712 00000100:00100000:0.0:1787862453.935896:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526371712 00000100:00100000:0.0:1787862453.935910:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862453.935916:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526371968:12345-0@lo:400: 00000100:00100000:0.0:1787862453.935951:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526371968:12345-0@lo:400: Request processed in 35us (3619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862453.935957:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862453.935968:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862453.935974:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526371584:12345-0@lo:400: 00000100:00100000:0.0:1787862453.936002:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526371584:12345-0@lo:400: Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862453.936008:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862453.936018:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787862453.936023:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526371712:12345-0@lo:400: 00000100:00100000:0.0:1787862453.936071:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526371712:12345-0@lo:400: Request processed in 47us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862453.936076:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787862453.936094:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862453.936099:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862453.936114:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372096 00000100:00100000:0.0:1787862453.936117:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372096 00000100:00100000:0.0:1787862453.936163:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862453.936170:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526372096:12345-0@lo:400: 00000100:00100000:0.0:1787862453.936211:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526372096:12345-0@lo:400: Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862453.936217:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787862453.936269:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651faebc00 x1874709526371712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862453.936282:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526371712:0@lo:400: 00010000:00080000:0.0:1787862453.936292:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651faead00 x1874709526371584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862453.936300:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526371584:0@lo:400: 00010000:00080000:0.0:1787862453.936308:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fae9a40 x1874709526372096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862453.936315:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787862453.936329:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526372096:0@lo:400: 00000100:00080000:0.0:1787862453.936347:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862453.936382:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526371456:0@lo:400: 00010000:00080000:0.0:1787862453.936394:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651faea1c0 x1874709526371968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862453.936401:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526371968:0@lo:400: 00000100:00100000:3.0:1787862454.260037:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862454.260323:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516910720 00000100:00100000:0.0:1787862454.260335:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516910720 00000100:00100000:0.0:1787862454.260400:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:0.0:1787862454.260412:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2345:x1874709516910720:12345-192.168.202.60@tcp:250: 00010000:00080000:0.0:1787862454.260447:0:5810:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 0f669f76-38ef-4f30-8d78-9f530fa777ac@192.168.202.60@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1787862454.260499:0:5810:0:(genops.c:1385:class_connect()) connect: client 0f669f76-38ef-4f30-8d78-9f530fa777ac, cookie 0x9c5536ccf892fc40 00000100:00080000:0.0:1787862454.260637:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9a6537e69000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862454.260722:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+5:2345:x1874709516910720:12345-192.168.202.60@tcp:250: Request processed in 310us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.260731:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:3.0:1787862454.268392:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862454.268526:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516910848 00000100:00100000:1.0:1787862454.268537:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516910848 00000100:00100000:1.0:1787862454.268596:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 114 00000100:00100000:1.0:1787862454.268607:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+5:5577:x1874709516910848:12345-192.168.202.60@tcp:101: 00010000:00010000:1.0:1787862454.268627:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862454.268651:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34567 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.268686:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.268706:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.268716:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45400, rc 0) 00000100:00100000:1.0:1787862454.268781:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+6:5577:x1874709516910848:12345-192.168.202.60@tcp:101: Request processed in 175us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.268801:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 114 00000100:00100000:3.0:1787862454.272006:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862454.272246:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516910976 00000100:00100000:1.0:1787862454.272256:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516910976 00000100:00100000:1.0:1787862454.272308:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:1.0:1787862454.272317:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+6:5577:x1874709516910976:12345-192.168.202.60@tcp:501: 00000100:00100000:1.0:1787862454.272664:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+6:5577:x1874709516910976:12345-192.168.202.60@tcp:501: Request processed in 346us (667us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787862454.272672:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:3.0:1787862454.290075:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862454.290161:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911104 00000100:00100000:2.0:1787862454.290173:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911104 00000100:00100000:2.0:1787862454.290235:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 116 00000100:00100000:2.0:1787862454.290247:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+6:5577:x1874709516911104:12345-192.168.202.60@tcp:101: 00010000:00010000:2.0:1787862454.290290:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862454.290313:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b3456e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.290348:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.290363:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862454.290373:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc400, rc 0) 00000100:00100000:2.0:1787862454.290445:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+7:5577:x1874709516911104:12345-192.168.202.60@tcp:101: Request processed in 200us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.290452:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 116 00000100:00100000:1.0:1787862454.296275:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.298853:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911232 00000100:00100000:3.0:1787862454.298870:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911232 00000100:00100000:3.0:1787862454.298946:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:3.0:1787862454.298977:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+7:5577:x1874709516911232:12345-192.168.202.60@tcp:501: 00000100:00100000:3.0:1787862454.299331:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5577:x1874709516911232:12345-192.168.202.60@tcp:501: Request processed in 355us (3066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.299340:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:3.0:1787862454.301797:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.301836:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911360 00000100:00100000:3.0:1787862454.301846:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911360 00000100:00100000:3.0:1787862454.301896:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:3.0:1787862454.301908:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5577:x1874709516911360:12345-192.168.202.60@tcp:503: 00000100:00100000:3.0:1787862454.303636:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5577:x1874709516911360:12345-192.168.202.60@tcp:503: Request processed in 1721us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.303650:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:3.0:1787862454.314933:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862454.315245:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911488 00000100:00100000:0.0:1787862454.315256:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911488 00000100:00100000:0.0:1787862454.315319:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 119 00000100:00100000:0.0:1787862454.315330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5596:x1874709516911488:12345-192.168.202.60@tcp:502: 00000100:00100000:0.0:1787862454.315704:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5596:x1874709516911488:12345-192.168.202.60@tcp:502: Request processed in 365us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.315714:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 119 00000100:00100000:3.0:1787862454.369289:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862454.369379:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911616 00000100:00100000:0.0:1787862454.369390:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911616 00000100:00100000:0.0:1787862454.369468:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 120 00000100:00100000:0.0:1787862454.369481:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5596:x1874709516911616:12345-192.168.202.60@tcp:502: 00000100:00100000:0.0:1787862454.369795:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5596:x1874709516911616:12345-192.168.202.60@tcp:502: Request processed in 314us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.369803:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 120 00000100:00100000:3.0:1787862454.372007:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862454.374402:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911744 00000100:00100000:1.0:1787862454.374419:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911744 00000100:00100000:1.0:1787862454.374484:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:1.0:1787862454.374495:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5577:x1874709516911744:12345-192.168.202.60@tcp:101: 00010000:00010000:1.0:1787862454.374516:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862454.374535:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af44600/0x9c5536ccf892fc55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34598 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.374566:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af44600/0x9c5536ccf892fc55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34598 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.374577:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af44600/0x9c5536ccf892fc55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34598 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862454.374587:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44600, rc 0) 00000100:00100000:1.0:1787862454.374680:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5577:x1874709516911744:12345-192.168.202.60@tcp:101: Request processed in 179us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.374688:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:1.0:1787862454.380950:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.381793:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516911872 00000100:00100000:3.0:1787862454.381805:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516911872 00000100:00100000:3.0:1787862454.381866:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:3.0:1787862454.381878:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5577:x1874709516911872:12345-192.168.202.60@tcp:256: 20000000:01000000:3.0:1787862454.381906:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787862454.381930:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787862454.381934:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787862454.381937:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787862454.381940:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787862454.386908:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5577:x1874709516911872:12345-192.168.202.60@tcp:256: Request processed in 5022us (5957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.386924:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:0.0:1787862454.391565:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862454.391606:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912000 00000100:00100000:0.0:1787862454.391615:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912000 00000100:00100000:0.0:1787862454.391669:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:0.0:1787862454.391692:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5577:x1874709516912000:12345-192.168.202.60@tcp:101: 00010000:00010000:0.0:1787862454.391720:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862454.391740:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b3459f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.391787:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.391799:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862454.391810:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00100000:0.0:1787862454.391867:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5577:x1874709516912000:12345-192.168.202.60@tcp:101: Request processed in 178us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862454.391874:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:0.0:1787862454.401317:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.401409:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912128 00000100:00100000:3.0:1787862454.401425:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912128 00000100:00100000:3.0:1787862454.401492:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:3.0:1787862454.401503:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5577:x1874709516912128:12345-192.168.202.60@tcp:501: 00000100:00100000:3.0:1787862454.401844:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5577:x1874709516912128:12345-192.168.202.60@tcp:501: Request processed in 342us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.401853:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:0.0:1787862454.404275:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.404351:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912256 00000100:00100000:3.0:1787862454.404361:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912256 00000100:00100000:3.0:1787862454.404423:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:3.0:1787862454.404435:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5577:x1874709516912256:12345-192.168.202.60@tcp:503: 00000100:00100000:3.0:1787862454.405005:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5577:x1874709516912256:12345-192.168.202.60@tcp:503: Request processed in 571us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.405021:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:0.0:1787862454.407981:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.408131:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912384 00000100:00100000:3.0:1787862454.408149:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912384 00000100:00100000:3.0:1787862454.408203:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 126 00000100:00100000:3.0:1787862454.408213:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5599:x1874709516912384:12345-192.168.202.60@tcp:502: 00000100:00100000:3.0:1787862454.408512:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5599:x1874709516912384:12345-192.168.202.60@tcp:502: Request processed in 300us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.408520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 126 00000100:00100000:0.0:1787862454.410783:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.410886:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912512 00000100:00100000:3.0:1787862454.410898:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912512 00000100:00100000:3.0:1787862454.410960:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:3.0:1787862454.410970:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5599:x1874709516912512:12345-192.168.202.60@tcp:502: 00000100:00100000:3.0:1787862454.411305:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5599:x1874709516912512:12345-192.168.202.60@tcp:502: Request processed in 334us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.411314:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:2.0:1787862454.418861:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.419423:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912640 00000100:00100000:3.0:1787862454.419435:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912640 00000100:00100000:3.0:1787862454.419499:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:3.0:1787862454.419508:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1874709516912640:12345-192.168.202.60@tcp:38: 00010000:00080000:3.0:1787862454.419544:0:5816:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1787862454.419595:0:5816:0:(genops.c:1385:class_connect()) connect: client 21567a16-68b5-41a8-a3f6-27f314a231da, cookie 0x9c5536ccf892fc63 00000004:00100000:3.0:1787862454.419630:0:5816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1787862454.419637:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787862454.440855:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526372224:0@lo:13: 00000100:00100000:1.0:1787862454.440948:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862454.441214:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372224 00000100:00100000:1.0:1787862454.441225:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372224 00000100:00100000:1.0:1787862454.441284:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862454.441293:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526372224:12345-0@lo:13: 00002000:00000024:1.0:1787862454.441328:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862454.441375:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526372224:12345-0@lo:13: Request processed in 82us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.441382:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787862454.441436:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a640319b840 x1874709526372224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862454.441457:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526372224:0@lo:13: 00000100:00080000:3.0:1787862454.456216:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9a6509830800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862454.456318:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2345:x1874709516912640:12345-192.168.202.60@tcp:38: Request processed in 36808us (37467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862454.456345:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00010000:00010000:2.0:1787862454.812227:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862454.964281:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862454.964341:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862454.964832:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912896 00000100:00100000:2.0:1787862454.964845:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912896 00000100:00100000:2.0:1787862454.964935:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516912768 00000100:00100000:2.0:1787862454.964938:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516912768 00000100:00100000:2.0:1787862454.964977:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1787862454.964988:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:5577:x1874709516912896:12345-192.168.202.60@tcp:41: 00000004:00000024:2.0:1787862454.965037:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787862454.965179:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:5577:x1874709516912896:12345-192.168.202.60@tcp:41: Request processed in 193us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.965187:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1787862454.965207:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:2.0:1787862454.965213:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:0:x1874709516912768:12345-192.168.202.60@tcp:41: 00000004:00000024:2.0:1787862454.965240:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787862454.965262:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:0:x1874709516912768:12345-192.168.202.60@tcp:41: Request processed in 50us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.965269:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00080000:0.0:1787862454.965923:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862454.970488:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862454.976936:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913024 00000100:00100000:2.0:1787862454.977011:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913024 00000100:00100000:2.0:1787862454.977188:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:2.0:1787862454.977202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:5577:x1874709516913024:12345-192.168.202.60@tcp:40: 00000100:00100000:2.0:1787862454.977312:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:5577:x1874709516913024:12345-192.168.202.60@tcp:40: Request processed in 113us (6833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862454.977320:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787862454.981972:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862454.982195:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913152 00000100:00100000:1.0:1787862454.982207:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913152 00000100:00100000:1.0:1787862454.982291:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:1.0:1787862454.982301:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709516913152:12345-192.168.202.60@tcp:8: 00010000:00080000:1.0:1787862454.982342:0:6670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1787862454.982382:0:6670:0:(genops.c:1385:class_connect()) connect: client 21567a16-68b5-41a8-a3f6-27f314a231da, cookie 0x9c5536ccf892fc6a 00002000:00100000:1.0:1787862454.982397:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 21567a16-68b5-41a8-a3f6-27f314a231da/ffff9a65403ad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787862454.982424:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:3.0:1787862454.982531:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00002000:00080000:1.0:1787862454.982835:0:6670:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787862454.982871:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a65403ae000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862454.982948:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2345:x1874709516913152:12345-192.168.202.60@tcp:8: Request processed in 646us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.982971:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1787862454.986986:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862454.987025:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913408 00000100:00100000:3.0:1787862454.987036:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913408 00000100:00100000:3.0:1787862454.987106:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:3.0:1787862454.987118:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:5577:x1874709516913408:12345-192.168.202.60@tcp:33: 00000100:00100000:1.0:1787862454.990803:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913280 00000100:00100000:1.0:1787862454.990819:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913280 00000100:00100000:1.0:1787862454.990865:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862454.990875:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709516913280:12345-192.168.202.60@tcp:8: 00010000:00080000:1.0:1787862454.990913:0:6670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1787862454.990949:0:6670:0:(genops.c:1385:class_connect()) connect: client 21567a16-68b5-41a8-a3f6-27f314a231da, cookie 0x9c5536ccf892fc71 00002000:00100000:1.0:1787862454.990960:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 21567a16-68b5-41a8-a3f6-27f314a231da/ffff9a65403af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787862454.990971:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787862454.991387:0:6670:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787862454.991426:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a65403a8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862454.991501:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2345:x1874709516913280:12345-192.168.202.60@tcp:8: Request processed in 625us (8971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862454.991508:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000004:00080000:3.0:1787862455.013489:0:5818:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26256us 00000004:00200000:1.0:1787862455.027116:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787862455.027305:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:5577:x1874709516913408:12345-192.168.202.60@tcp:33: Request processed in 40181us (40323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862455.027322:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:3.0:1787862455.203496:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862455.203629:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913536 00000100:00100000:1.0:1787862455.203640:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913536 00000100:00100000:1.0:1787862455.203809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:1.0:1787862455.203821:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:5616:x1874709516913536:12345-192.168.202.60@tcp:101: 00010000:00010000:1.0:1787862455.203853:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862455.203928:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44000/0x9c5536ccf892fc78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b345c9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.204027:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf892fc7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.204076:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf892fc7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.204092:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf892fc7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862455.204558:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787862455.204564:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862455.204648:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf892fc7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.204680:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44000/0x9c5536ccf892fc78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345c9 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.204730:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf892fc7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345c9 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862455.204740:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880400) 00010000:00010000:1.0:1787862455.204743:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862455.204747:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44a00, rc 0) 00000100:00100000:1.0:1787862455.204888:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:5616:x1874709516913536:12345-192.168.202.60@tcp:101: Request processed in 1069us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862455.204896:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00010000:00010000:1.0:1787862455.838165:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862455.964366:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862455.964407:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526372352:0@lo:13: 00000100:00100000:3.0:1787862455.964489:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862455.964634:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372352 00000100:00100000:1.0:1787862455.964667:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372352 00000100:00100000:1.0:1787862455.964760:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862455.964771:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526372352:12345-0@lo:13: 00002000:00000024:1.0:1787862455.964794:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862455.964849:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526372352:12345-0@lo:13: Request processed in 80us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862455.964856:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787862455.965037:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a64031983c0 x1874709526372352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862455.965081:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526372352:0@lo:13: 00000100:00080000:2.0:1787862455.965264:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862456.861404:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862457.697794:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862457.697930:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913664 00000100:00100000:2.0:1787862457.697942:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913664 00000100:00100000:2.0:1787862457.698090:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787862457.698109:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:5668:x1874709516913664:12345-192.168.202.60@tcp:41: 00000004:00000024:2.0:1787862457.698163:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787862457.698256:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:5668:x1874709516913664:12345-192.168.202.60@tcp:41: Request processed in 155us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862457.698264:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:0.0:1787862457.698454:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862457.715508:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862457.716497:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913792 00000100:00100000:1.0:1787862457.716514:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913792 00000100:00100000:1.0:1787862457.716607:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862457.716621:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:21567a16-68b5-41a8-a3f6-27f314a231da+6:5668:x1874709516913792:12345-192.168.202.60@tcp:13: 00002000:00000024:1.0:1787862457.716682:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862457.716775:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:21567a16-68b5-41a8-a3f6-27f314a231da+6:5668:x1874709516913792:12345-192.168.202.60@tcp:13: Request processed in 157us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862457.716782:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:0.0:1787862457.717065:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862457.720121:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862457.721290:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516913920 00000100:00100000:2.0:1787862457.721306:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516913920 00000100:00100000:2.0:1787862457.721405:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787862457.721418:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:21567a16-68b5-41a8-a3f6-27f314a231da+6:5668:x1874709516913920:12345-192.168.202.60@tcp:13: 00002000:00000024:2.0:1787862457.721462:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862457.721559:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:21567a16-68b5-41a8-a3f6-27f314a231da+6:5668:x1874709516913920:12345-192.168.202.60@tcp:13: Request processed in 145us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862457.721567:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00080000:0.0:1787862457.721714:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862457.885271:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862458.908474:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862459.037640:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526372864:0@lo:400: 00000100:00100000:3.0:1787862459.037724:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862459.037794:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787862459.037801:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526372480:0@lo:400: 00000100:00100000:3.0:1787862459.037829:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862459.037848:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526372992:0@lo:400: 00000100:00100000:3.0:1787862459.038212:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862459.038264:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526372608:0@lo:400: 00000100:00100000:3.0:1787862459.038290:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862459.038307:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526373120:0@lo:400: 00000100:00100000:3.0:1787862459.038331:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862459.038428:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372992 00000100:00100000:1.0:1787862459.038436:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372992 00000100:00100000:1.0:1787862459.038483:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372608 00000100:00100000:1.0:1787862459.038486:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372608 00000100:00100000:1.0:1787862459.038506:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787862459.038515:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526372992:12345-0@lo:400: 00000100:00100000:1.0:1787862459.038579:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526372992:12345-0@lo:400: Request processed in 65us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862459.038587:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787862459.038603:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787862459.038608:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526372608:12345-0@lo:400: 00000100:00100000:1.0:1787862459.038640:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526372608:12345-0@lo:400: Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862459.038646:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787862459.038793:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526372608:0@lo:400: 00000100:00100000:3.0:1787862459.038811:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862459.038818:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526372736:0@lo:400: 00000100:00100000:3.0:1787862459.038841:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862459.038974:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372480 00000100:00100000:0.0:1787862459.038979:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372480 00000100:00100000:0.0:1787862459.039006:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787862459.039014:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526372480:12345-0@lo:400: 00000100:00100000:0.0:1787862459.039076:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526372480:12345-0@lo:400: Request processed in 63us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862459.039088:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787862459.039127:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862459.039474:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372864 00000100:00100000:3.0:1787862459.039479:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372864 00000100:00100000:3.0:1787862459.039510:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373120 00000100:00100000:3.0:1787862459.039513:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373120 00000100:00100000:3.0:1787862459.039529:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862459.039535:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526372864:12345-0@lo:400: 00000100:00100000:3.0:1787862459.040185:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526372864:12345-0@lo:400: Request processed in 648us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862459.040193:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862459.040211:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862459.040219:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526373120:12345-0@lo:400: 00000100:00100000:3.0:1787862459.040256:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526373120:12345-0@lo:400: Request processed in 39us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862459.040262:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862459.040280:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526372736 00000100:00100000:3.0:1787862459.040283:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526372736 00000100:00100000:3.0:1787862459.040311:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787862459.040318:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526372736:12345-0@lo:400: 00000100:00100000:3.0:1787862459.040348:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526372736:12345-0@lo:400: Request processed in 31us (1507us total) trans 0 rc 0/0 00000100:00080000:0.0:1787862459.040948:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862459.040953:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862459.040955:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862459.041291:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526372480:0@lo:400: 00000100:00100000:0.0:1787862459.041310:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526372992:0@lo:400: 00010000:00080000:0.0:1787862459.041326:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fae9a40 x1874709526372864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862459.041337:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526372864:0@lo:400: 00000100:00100000:3.0:1787862459.041504:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862459.041760:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526372736:0@lo:400: 00010000:00080000:2.0:1787862459.041775:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651faebc00 x1874709526373120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862459.041785:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526373120:0@lo:400: 00000001:00100000:1.0:1787862459.104228:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000100:00100000:1.0:1787862459.554507:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526373248:0@lo:13: 00000100:00100000:1.0:1787862459.554591:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862459.554729:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373248 00000100:00100000:0.0:1787862459.554738:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373248 00000100:00100000:0.0:1787862459.557213:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862459.557234:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526373248:12345-0@lo:13: 00002000:00000024:0.0:1787862459.557280:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862459.557365:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526373248:12345-0@lo:13: Request processed in 138us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862459.557373:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787862459.569365:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fea8f00 x1874709526373248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862459.569396:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526373248:0@lo:13: 00000001:00100000:0.0:1787862459.630148:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00010000:00010000:1.0:1787862459.932289:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862460.115441:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862460.115488:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862460.115811:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862460.115851:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862460.115907:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914176 00000100:00100000:1.0:1787862460.115918:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914176 00000100:00100000:1.0:1787862460.115982:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787862460.115993:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516914176:12345-192.168.202.60@tcp:400: 00000100:00100000:1.0:1787862460.116081:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516914176:12345-192.168.202.60@tcp:400: Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862460.116089:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00080000:1.0:1787862460.116109:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862460.116312:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914048 00000100:00100000:0.0:1787862460.116317:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914048 00000100:00100000:0.0:1787862460.116355:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:0.0:1787862460.116362:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516914048:12345-192.168.202.60@tcp:400: 00000100:00100000:0.0:1787862460.116388:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516914048:12345-192.168.202.60@tcp:400: Request processed in 28us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862460.116411:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:3.0:1787862460.128828:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914304 00000100:00100000:3.0:1787862460.128844:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914304 00000100:00080000:3.0:1787862460.128885:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862460.128934:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914432 00000100:00100000:3.0:1787862460.128937:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914432 00000100:00100000:3.0:1787862460.128966:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1787862460.128976:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516914304:12345-192.168.202.60@tcp:400: 00000100:00100000:3.0:1787862460.129090:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516914304:12345-192.168.202.60@tcp:400: Request processed in 103us (13589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862460.129098:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1787862460.129113:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862460.129121:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516914432:12345-192.168.202.60@tcp:400: 00000100:00100000:3.0:1787862460.129146:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516914432:12345-192.168.202.60@tcp:400: Request processed in 27us (13294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862460.129152:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00080000:3.0:1787862460.129165:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787862460.139490:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00010000:00010000:1.0:1787862460.958214:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862461.088401:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526373376:0@lo:13: 00000100:00100000:1.0:1787862461.088480:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862461.088576:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373376 00000100:00100000:0.0:1787862461.088585:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373376 00000100:00100000:0.0:1787862461.088683:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862461.088694:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526373376:12345-0@lo:13: 00000100:00080000:1.0:1787862461.088711:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787862461.088740:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862461.088806:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526373376:12345-0@lo:13: Request processed in 114us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862461.088814:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787862461.088914:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fea8780 x1874709526373376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862461.088933:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526373376:0@lo:13: 00000001:02000400:2.0:1787862461.235365:0:8286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787862461.980725:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862463.004160:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862464.028240:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862464.162901:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526373632:0@lo:400: 00000100:00100000:2.0:1787862464.163013:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862464.163119:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526374144:0@lo:400: 00000100:00100000:2.0:1787862464.163150:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862464.163182:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862464.163188:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526373760:0@lo:400: 00000100:00100000:2.0:1787862464.163215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862464.163253:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373632 00000100:00100000:2.0:1787862464.163262:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373632 00000100:00100000:2.0:1787862464.163314:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373760 00000100:00100000:2.0:1787862464.163317:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373760 00000100:00100000:2.0:1787862464.163349:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862464.163366:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526373632:12345-0@lo:400: 00000100:00100000:2.0:1787862464.164185:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526374144 00000100:00100000:2.0:1787862464.164195:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526374144 00000100:00100000:2.0:1787862464.164240:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862464.164249:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526374144:12345-0@lo:400: 00000100:00100000:2.0:1787862464.164322:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526374144:12345-0@lo:400: Request processed in 74us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862464.164330:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862464.164361:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862464.164369:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526373760:12345-0@lo:400: 00000100:00100000:2.0:1787862464.164414:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526373760:12345-0@lo:400: Request processed in 46us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862464.164424:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862464.164722:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526373760:0@lo:400: 00010000:00080000:2.0:1787862464.164739:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651faebc00 x1874709526374144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862464.164750:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526374144:0@lo:400: 00000100:00100000:2.0:1787862464.164816:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526373632:12345-0@lo:400: Request processed in 1451us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862464.164823:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862464.164849:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526373632:0@lo:400: 00000100:00100000:1.0:1787862464.165421:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526373504:0@lo:400: 00000100:00100000:1.0:1787862464.165503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862464.165547:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526374016:0@lo:400: 00000100:00100000:2.0:1787862464.165854:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373504 00000100:00100000:2.0:1787862464.165863:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373504 00000100:00100000:2.0:1787862464.165916:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787862464.165927:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526373504:12345-0@lo:400: 00000100:00100000:2.0:1787862464.166510:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526373504:12345-0@lo:400: Request processed in 584us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862464.166519:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787862464.166765:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862464.166819:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526373504:0@lo:400: 00000100:00100000:1.0:1787862464.166835:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862464.166844:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526373888:0@lo:400: 00000100:00100000:1.0:1787862464.166873:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862464.166918:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526374016 00000100:00100000:1.0:1787862464.166923:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526374016 00000100:00100000:1.0:1787862464.166961:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862464.166968:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526374016:12345-0@lo:400: 00000100:00100000:0.0:1787862464.167508:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526373888 00000100:00100000:0.0:1787862464.167513:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526373888 00000100:00100000:0.0:1787862464.167543:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862464.167551:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526373888:12345-0@lo:400: 00000100:00100000:0.0:1787862464.177285:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526373888:12345-0@lo:400: Request processed in 9725us (10401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862464.177309:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787862464.177451:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fae9a40 x1874709526373888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862464.177467:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526373888:0@lo:400: 00000100:00080000:2.0:1787862464.178166:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862464.178173:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862464.178176:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862464.184342:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526374016:12345-0@lo:400: Request processed in 17364us (17566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862464.184358:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862464.195886:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526374016:0@lo:400: 00000100:00100000:0.0:1787862464.670062:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862464.670086:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526374272:0@lo:13: 00000100:00100000:0.0:1787862464.670154:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862464.670223:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526374272 00000100:00100000:0.0:1787862464.670231:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526374272 00000100:00100000:0.0:1787862464.670278:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862464.670288:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526374272:12345-0@lo:13: 00002000:00000024:0.0:1787862464.670327:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862464.670373:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526374272:12345-0@lo:13: Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862464.670388:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787862464.670429:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651feab0c0 x1874709526374272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862464.670448:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526374272:0@lo:13: 00010000:00010000:1.0:1787862465.053215:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862465.232453:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862465.232490:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862465.232517:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862465.232548:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862465.232584:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914560 00000100:00100000:1.0:1787862465.232602:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914560 00000100:00100000:1.0:1787862465.232654:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:1.0:1787862465.232665:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2347:x1874709516914560:12345-192.168.202.60@tcp:400: 00000100:00100000:1.0:1787862465.232734:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2347:x1874709516914560:12345-192.168.202.60@tcp:400: Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862465.232754:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:1.0:1787862465.232789:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914944 00000100:00100000:1.0:1787862465.232793:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914944 00000100:00100000:1.0:1787862465.232828:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914816 00000100:00100000:1.0:1787862465.232831:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914816 00000100:00100000:1.0:1787862465.232846:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862465.232851:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516914944:12345-192.168.202.60@tcp:400: 00000100:00100000:1.0:1787862465.232880:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516914944:12345-192.168.202.60@tcp:400: Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862465.232886:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862465.232896:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:1.0:1787862465.232901:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516914816:12345-192.168.202.60@tcp:400: 00000100:00100000:1.0:1787862465.232920:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516914816:12345-192.168.202.60@tcp:400: Request processed in 19us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862465.233329:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00080000:1.0:1787862465.233465:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862465.233470:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862465.233734:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516914688 00000100:00100000:2.0:1787862465.233740:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516914688 00000100:00100000:2.0:1787862465.233785:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:2.0:1787862465.233794:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516914688:12345-192.168.202.60@tcp:400: 00000100:00100000:2.0:1787862465.233831:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516914688:12345-192.168.202.60@tcp:400: Request processed in 39us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.233837:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00080000:1.0:1787862465.234655:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1787862465.783279:0:8435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb2ef96a0 20000000:00000080:0.0:1787862465.783306:0:8435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a651fe93000 uarg=0000000000000000 20000000:01000000:0.0:1787862465.783340:0:8435:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787862465.783342:0:8435:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787862465.783344:0:8435:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787862465.783349:0:8435:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787862465.783353:0:8435:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787862465.783367:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787862465.783370:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787862465.783604:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787862465.783607:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787862465.785977:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787862465.787571:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787862465.787636:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787862465.787690:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787862465.787707:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787862465.787710:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787862465.791214:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787862465.792496:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787862465.792564:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787862465.792614:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787862465.792630:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787862465.792632:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787862465.794313:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787862465.794873:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787862465.794945:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787862465.794983:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787862465.794997:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787862465.794999:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787862465.796833:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787862465.797236:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787862465.797283:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787862465.797319:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1787862465.797335:0:8435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787862465.797381:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797400:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797408:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797416:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797423:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797429:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797436:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797443:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797464:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797471:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797478:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797927:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.797945:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 9 pid: 5810 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.797959:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374400:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862465.798096:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798104:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 9 pid: 5809 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798112:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374528:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862465.798142:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798150:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 18 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798171:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374656:0@lo:104: 00000100:00100000:3.0:1787862465.798213:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862465.798275:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798284:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 18 pid: 5810 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798292:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374784:0@lo:104: 00000100:00100000:2.0:1787862465.798296:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526374656 00000100:00100000:2.0:1787862465.798303:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526374656 00000100:00100000:3.0:1787862465.798314:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862465.798336:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798343:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 18 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798351:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374912:0@lo:104: 00000100:00100000:2.0:1787862465.798351:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787862465.798359:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526374784 00000100:00100000:2.0:1787862465.798362:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526374784 00000100:00100000:2.0:1787862465.798378:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787862465.798380:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862465.798386:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:8435:x1874709526374656:12345-0@lo:104: 00010000:00010000:3.0:1787862465.798397:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.798398:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798405:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 18 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798413:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375040:0@lo:104: 00000100:00100000:3.0:1787862465.798430:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862465.798444:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.798450:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787862465.798462:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 18 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798470:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375168:0@lo:104: 00000100:00100000:3.0:1787862465.798491:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862465.798574:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798582:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 18 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798600:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375296:0@lo:104: 00000100:00100000:3.0:1787862465.798622:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862465.798639:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.798647:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 18 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.798655:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e09a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375424:0@lo:104: 00000100:00100000:2.0:1787862465.798668:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:8435:x1874709526374656:12345-0@lo:104: Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862465.798673:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862465.798676:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787862465.798682:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862465.798691:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526374912 00000100:00100000:2.0:1787862465.798694:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526374912 00000100:00100000:2.0:1787862465.798704:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375040 00000100:00100000:2.0:1787862465.798705:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375040 00000100:00100000:3.0:1787862465.798711:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374656:0@lo:104: 00000100:00100000:2.0:1787862465.798714:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375168 00000100:00100000:2.0:1787862465.798716:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375168 00000100:00100000:2.0:1787862465.798723:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375296 00000100:00100000:2.0:1787862465.798725:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375296 00000100:00100000:2.0:1787862465.798733:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375424 00000100:00100000:2.0:1787862465.798735:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375424 00000100:00100000:2.0:1787862465.798744:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862465.798749:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653f173050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+8:8435:x1874709526374784:12345-0@lo:104: 00010000:00010000:2.0:1787862465.798757:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.798805:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787862465.798810:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653f173050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+8:8435:x1874709526374784:12345-0@lo:104: Request processed in 61us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.798816:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862465.798846:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862465.798851:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+7:8435:x1874709526374912:12345-0@lo:104: 00010000:00010000:2.0:1787862465.798858:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.798897:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787862465.798902:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+7:8435:x1874709526374912:12345-0@lo:104: Request processed in 51us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.798908:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862465.798919:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787862465.798994:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374784:0@lo:104: 00000100:00100000:3.0:1787862465.799003:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374912:0@lo:104: 00010000:00010000:0.0:1787862465.799854:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787862465.799861:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.799870:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919e00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862465.799873:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.799881:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862465.799901:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862465.799907:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787862465.799972:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.799979:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862465.800007:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800014:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c919e00/0x9c5536ccf892fc32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fc39 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800034:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862465.800038:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800061:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfda00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862465.800064:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800070:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862465.800076:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862465.800081:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787862465.800101:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800107:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862465.800112:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800119:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fc0f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800135:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862465.800138:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800143:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862465.800146:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.800147:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526375552:0@lo:103: 00010000:00010000:0.0:1787862465.800152:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862465.800158:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862465.800163:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787862465.800180:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862465.800187:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800193:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862465.800206:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800221:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf892fbec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbf3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.800225:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787862465.800229:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862465.800230:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862465.800231:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526375680:0@lo:103: 00010000:00010000:0.0:1787862465.800232:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862465.800241:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526375808:0@lo:103: 00000100:00100000:3.0:1787862465.800251:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862465.800264:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862465.800293:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375552 00000100:00100000:0.0:1787862465.800298:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375552 00010000:00010000:0.0:1787862465.800331:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 19 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862465.800348:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375680 00000100:00100000:0.0:1787862465.800351:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375680 00000100:00100000:1.0:1787862465.800359:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375808 00010000:00010000:0.0:1787862465.800361:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 20 pid: 5810 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862465.800362:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375808 00000100:00100000:0.0:1787862465.800373:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787862465.800376:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 21 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862465.800379:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+21:3283:x1874709526375552:12345-0@lo:103: 00000100:00100000:1.0:1787862465.800389:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787862465.800389:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787862465.800394:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787862465.800394:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 21 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800403:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 21 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800417:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918e00/0x9c5536ccf892fc39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fc32 expref: 21 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800434:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862465.800470:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+20:3283:x1874709526375552:12345-0@lo:103: Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862465.800476:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862465.800489:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862465.800494:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526375680:12345-0@lo:103: 00010000:00010000:0.0:1787862465.800502:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862465.800505:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 19 pid: 5810 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800513:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 19 pid: 5810 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800521:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd400/0x9c5536ccf892fc0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fc08 expref: 19 pid: 5810 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800530:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862465.800770:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3283:x1874709526375680:12345-0@lo:103: Request processed in 275us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862465.800777:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862465.800790:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862465.800795:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3281:x1874709526375808:12345-0@lo:103: 00010000:00010000:0.0:1787862465.800803:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862465.800806:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 17 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800814:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 17 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800830:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919400/0x9c5536ccf892fbf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fbec expref: 17 pid: 5809 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862465.800838:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862465.800864:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3281:x1874709526375808:12345-0@lo:103: Request processed in 69us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862465.800869:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862465.800895:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526375808:0@lo:103: 00000100:00100000:2.0:1787862465.801141:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+6:8435:x1874709526375040:12345-0@lo:104: 00010000:00010000:2.0:1787862465.801150:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801193:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862465.801198:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+6:8435:x1874709526375040:12345-0@lo:104: Request processed in 63us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.801204:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862465.801225:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862465.801232:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:8435:x1874709526375168:12345-0@lo:104: 00010000:00010000:2.0:1787862465.801239:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801266:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787862465.801271:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:8435:x1874709526375168:12345-0@lo:104: Request processed in 41us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.801276:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862465.801300:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862465.801314:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:8435:x1874709526375296:12345-0@lo:104: 00010000:00010000:2.0:1787862465.801321:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801352:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787862465.801357:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:8435:x1874709526375296:12345-0@lo:104: Request processed in 51us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.801362:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862465.801374:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862465.801380:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:8435:x1874709526375424:12345-0@lo:104: 00010000:00010000:2.0:1787862465.801387:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801410:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787862465.801415:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:8435:x1874709526375424:12345-0@lo:104: Request processed in 36us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.801420:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787862465.801435:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787862465.801440:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801447:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862465.801450:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801458:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862465.801464:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862465.801470:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862465.801495:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801501:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862465.801510:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801516:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6501685000/0x9c5536ccf892fbde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbe5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801527:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787862465.801530:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801536:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862465.801538:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801545:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862465.801659:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862465.801665:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862465.801679:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801685:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862465.801691:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801708:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf892fbd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbd7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801717:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862465.801720:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801725:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501684400 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862465.801728:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801734:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862465.801739:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862465.801744:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862465.801756:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801761:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862465.801766:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801773:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6501684400/0x9c5536ccf892fba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fbad expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801782:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862465.801790:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801796:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862465.801799:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801805:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862465.801811:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862465.801816:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787862465.801824:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526376064:0@lo:103: 00010000:00010000:2.0:1787862465.801832:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801837:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862465.801841:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.801847:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc000/0x9c5536ccf892fb7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb83 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862465.801853:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787862465.801858:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862465.801860:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862465.801862:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862465.801868:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862465.801876:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526376192:0@lo:103: 00000100:00100000:1.0:1787862465.801900:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526375680:0@lo:103: 00000100:00100000:0.0:1787862465.801941:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526375936:0@lo:103: 00000100:00100000:2.0:1787862465.801982:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862465.802004:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376064 00000100:00100000:2.0:1787862465.802013:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376064 00010000:00010000:2.0:1787862465.802036:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 16 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.802075:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376192 00000100:00100000:2.0:1787862465.802077:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376192 00010000:00010000:2.0:1787862465.802087:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 17 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.802097:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862465.802101:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3283:x1874709526376064:12345-0@lo:103: 00010000:00010000:2.0:1787862465.802108:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862465.802112:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 17 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.802120:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 17 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.802130:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862465.802152:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3283:x1874709526376064:12345-0@lo:103: Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.802158:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862465.802172:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862465.802178:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3284:x1874709526376192:12345-0@lo:103: 00010000:00010000:2.0:1787862465.802184:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862465.802189:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 16 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.802197:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 16 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.802214:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862465.802248:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3284:x1874709526376192:12345-0@lo:103: Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.802254:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787862465.802269:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862465.802623:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526376192:0@lo:103: 00000100:00100000:3.0:1787862465.805718:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526376320:0@lo:103: 00000100:00100000:3.0:1787862465.805771:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862465.805833:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862465.805880:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374400:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862465.805891:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526374528:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862465.805902:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375040:0@lo:104: 00010000:00010000:3.0:1787862465.805914:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918a00/0x9c5536ccf892fbd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fbd0 expref: 15 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.805930:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375168:0@lo:104: 00010000:00010000:3.0:1787862465.805940:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fbad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fba6 expref: 14 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862465.805949:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375296:0@lo:104: 00000100:00100000:3.0:1787862465.805958:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e09a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874709526375424:0@lo:104: 00010000:00010000:3.0:1787862465.805993:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.806148:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376320 00000100:00100000:2.0:1787862465.806154:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376320 00010000:00010000:2.0:1787862465.806188:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 14 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.806210:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862465.806219:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3281:x1874709526376320:12345-0@lo:103: 00010000:00010000:2.0:1787862465.806231:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862465.806237:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 14 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.806246:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 14 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.806262:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fb83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fb7c expref: 14 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.806273:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862465.806322:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3281:x1874709526376320:12345-0@lo:103: Request processed in 103us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.806329:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787862465.806788:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526376320:0@lo:103: 00000100:00100000:3.0:1787862465.807297:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862465.807330:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862465.807690:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915072 00000100:00100000:2.0:1787862465.807696:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915072 00010000:00010000:2.0:1787862465.807718:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 10 pid: 5810 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.807746:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915200 00000100:00100000:2.0:1787862465.807750:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915200 00010000:00010000:2.0:1787862465.807762:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 11 pid: 5809 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.807775:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:2.0:1787862465.807782:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2349:x1874709516915072:12345-192.168.202.60@tcp:103: 00010000:00010000:2.0:1787862465.807791:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862465.807796:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 11 pid: 5810 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.807806:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 11 pid: 5810 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.807820:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfc400/0x9c5536ccf892fc4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3456e expref: 11 pid: 5810 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.807831:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862465.807878:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2349:x1874709516915072:12345-192.168.202.60@tcp:103: Request processed in 96us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.807885:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:2.0:1787862465.807936:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:2.0:1787862465.807942:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:2349:x1874709516915200:12345-192.168.202.60@tcp:103: 00010000:00010000:2.0:1787862465.807949:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862465.807954:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 9 pid: 5809 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.807974:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 9 pid: 5809 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.807984:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fc47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34567 expref: 9 pid: 5809 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.807994:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862465.808012:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:2349:x1874709516915200:12345-192.168.202.60@tcp:103: Request processed in 70us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862465.808018:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787862465.808174:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526375552:0@lo:103: 00000100:00100000:1.0:1787862465.808249:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526376064:0@lo:103: 00000100:00100000:1.0:1787862465.808963:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862465.809311:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526375936 00000100:00100000:2.0:1787862465.809318:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526375936 00010000:00010000:2.0:1787862465.809340:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 13 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.809372:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862465.809380:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:3282:x1874709526375936:12345-0@lo:103: 00010000:00010000:2.0:1787862465.809389:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862465.809394:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 13 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809404:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 13 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809418:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45c00/0x9c5536ccf892fbe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fbde expref: 13 pid: 5808 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809430:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809447:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809462:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809468:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809475:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809481:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809487:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862465.809491:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809500:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809519:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862465.809530:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862465.809564:0:8435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862465.809579:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.809585:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:3282:x1874709526375936:12345-0@lo:103: Request processed in 207us (623us total) trans 0 rc 0/0 00010000:00010000:3.0:1787862465.809586:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501685600/0x9c5536ccf892fc86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862465.809600:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787862465.810639:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526375936:0@lo:103: 00010000:00010000:2.0:1787862466.076145:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862466.140148:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862466.140257:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915328 00000100:00100000:3.0:1787862466.140267:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915328 00000100:00100000:3.0:1787862466.140326:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:3.0:1787862466.140336:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:5592:x1874709516915328:12345-192.168.202.60@tcp:101: 00010000:00010000:3.0:1787862466.140354:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862466.140374:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fc8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b345d0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862466.140411:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345d0 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862466.140422:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345d0 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862466.140432:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501685e00, rc 0) 00000100:00100000:3.0:1787862466.140511:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516915328:12345-192.168.202.60@tcp:101: Request processed in 176us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862466.140518:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:3.0:1787862466.142789:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862466.142919:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915456 00000100:00100000:1.0:1787862466.142929:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915456 00000100:00100000:1.0:1787862466.142989:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:1.0:1787862466.142999:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516915456:12345-192.168.202.60@tcp:501: 00000100:00100000:1.0:1787862466.143480:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516915456:12345-192.168.202.60@tcp:501: Request processed in 480us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862466.143490:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:0.0:1787862466.145959:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862466.146473:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915584 00000100:00100000:1.0:1787862466.146485:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915584 00000100:00100000:1.0:1787862466.146815:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 134 00000100:00100000:1.0:1787862466.146829:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516915584:12345-192.168.202.60@tcp:503: 00000100:00100000:1.0:1787862466.147184:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516915584:12345-192.168.202.60@tcp:503: Request processed in 358us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862466.147193:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 134 00000100:00100000:2.0:1787862466.158736:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862466.158844:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915712 00000100:00100000:3.0:1787862466.158859:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915712 00000100:00100000:3.0:1787862466.158922:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:3.0:1787862466.158948:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:6057:x1874709516915712:12345-192.168.202.60@tcp:502: 00000100:00100000:3.0:1787862466.159340:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:6057:x1874709516915712:12345-192.168.202.60@tcp:502: Request processed in 394us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862466.159349:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:3.0:1787862466.164326:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862466.164650:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915840 00000100:00100000:2.0:1787862466.164669:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915840 00000100:00100000:2.0:1787862466.164761:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 136 00000100:00100000:2.0:1787862466.164774:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:6057:x1874709516915840:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862466.165699:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:6057:x1874709516915840:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 925us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862466.165710:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 136 00000100:00100000:2.0:1787862466.175257:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862466.175828:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516915968 00000100:00100000:1.0:1787862466.175839:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516915968 00000100:00100000:1.0:1787862466.175897:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:1.0:1787862466.175908:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516915968:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862466.175925:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862466.175957:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af44000/0x9c5536ccf892fc94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b345d7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862466.175986:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af44000/0x9c5536ccf892fc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345d7 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862466.175998:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af44000/0x9c5536ccf892fc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345d7 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862466.176007:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44000, rc 0) 00000100:00100000:1.0:1787862466.176104:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516915968:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 198us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862466.176112:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:1.0:1787862466.179697:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862466.188156:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916096 00000100:00100000:2.0:1787862466.188174:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916096 00000100:00100000:2.0:1787862466.188266:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:2.0:1787862466.188276:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916096:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862466.189075:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916096:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 768us (9356us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862466.189085:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:3.0:1787862466.204637:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862466.204664:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526376448:0@lo:13: 00000100:00100000:3.0:1787862466.204736:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862466.205091:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376448 00000100:00100000:0.0:1787862466.205099:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376448 00000100:00100000:0.0:1787862466.205180:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862466.205198:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526376448:12345-0@lo:13: 00002000:00000024:0.0:1787862466.205235:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862466.205289:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526376448:12345-0@lo:13: Request processed in 92us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862466.205295:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787862466.205667:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ee8f00 x1874709526376448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862466.205686:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526376448:0@lo:13: 00000100:00080000:1.0:1787862466.205753:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862467.102809:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862467.676153:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787862467.676162:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a651c992800 from 39 10000000:01000000:2.0:1787862467.676168:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862467.676218:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.676229:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.676240:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862467.676301:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526376576:0@lo:101: 00000100:00100000:2.0:1787862467.676368:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.676432:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.676831:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376576 00000100:00100000:0.0:1787862467.676839:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376576 00000100:00100000:0.0:1787862467.682035:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787862467.682065:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+12:5813:x1874709526376576:12345-0@lo:101: 00010000:00010000:0.0:1787862467.682083:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862467.682100:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919200/0x9c5536ccf892fca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fc9b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.682145:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919200/0x9c5536ccf892fca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fc9b expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.682156:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919200/0x9c5536ccf892fca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fc9b expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.682166:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919200, rc 0) 00000100:00100000:0.0:1787862467.682517:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526376576:12345-0@lo:101: Request processed in 456us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.682641:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787862467.682805:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526376576:0@lo:101: 00010000:00010000:3.0:1787862467.682824:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.682834:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862467.682902:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526376704:0@lo:501: 00000100:00100000:3.0:1787862467.682937:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.682973:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862467.683032:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376704 00000100:00100000:2.0:1787862467.683038:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376704 00000100:00100000:2.0:1787862467.683102:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787862467.683110:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526376704:12345-0@lo:501: 00000100:00100000:2.0:1787862467.685254:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526376704:12345-0@lo:501: Request processed in 2138us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862467.685277:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787862467.687700:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526376704:0@lo:501: 00000100:00100000:3.0:1787862467.687763:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526376832:0@lo:503: 00000100:00100000:3.0:1787862467.687836:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.687883:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.688445:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376832 00000100:00100000:0.0:1787862467.688453:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376832 00000100:00100000:0.0:1787862467.688508:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787862467.688525:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526376832:12345-0@lo:503: 00000100:00100000:0.0:1787862467.688737:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526376832:12345-0@lo:503: Request processed in 219us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.688745:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787862467.688933:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526376832:0@lo:503: 00000100:00100000:3.0:1787862467.689660:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8459:1874709526376960:0@lo:502: 00000100:00100000:3.0:1787862467.689707:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.689741:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862467.690883:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526376960 00000100:00100000:2.0:1787862467.690892:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526376960 00000100:00100000:2.0:1787862467.690932:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787862467.690940:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:8459:x1874709526376960:12345-0@lo:502: 00000100:00100000:2.0:1787862467.691211:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:8459:x1874709526376960:12345-0@lo:502: Request processed in 271us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862467.691219:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787862467.691662:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8459:1874709526376960:0@lo:502: 00000100:00100000:3.0:1787862467.691717:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8459:1874709526377088:0@lo:502: 00000100:00100000:3.0:1787862467.691756:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.691783:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.691995:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377088 00000100:00100000:0.0:1787862467.692000:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377088 00000100:00100000:0.0:1787862467.692067:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787862467.692075:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:8459:x1874709526377088:12345-0@lo:502: 00000100:00100000:0.0:1787862467.692234:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:8459:x1874709526377088:12345-0@lo:502: Request processed in 160us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.692241:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787862467.693736:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8459:1874709526377088:0@lo:502: 00000040:00080000:3.0:1787862467.693765:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787862467.694726:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787862467.694752:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862467.694763:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.694775:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862467.694784:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787862467.694805:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787862467.694808:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787862467.694841:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.694850:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.694860:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862467.694880:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377216:0@lo:101: 00000100:00100000:2.0:1787862467.694935:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.694988:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.695018:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377216 00000100:00100000:0.0:1787862467.695024:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377216 00000100:00100000:0.0:1787862467.695087:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787862467.695102:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+13:5813:x1874709526377216:12345-0@lo:101: 00010000:00010000:0.0:1787862467.695115:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862467.695127:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919e00/0x9c5536ccf892fcb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fca9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.695149:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919e00/0x9c5536ccf892fcb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fca9 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.695159:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919e00/0x9c5536ccf892fcb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fca9 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.695168:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919e00, rc 0) 00000100:00100000:0.0:1787862467.695202:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526377216:12345-0@lo:101: Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.695208:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787862467.695349:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377216:0@lo:101: 00010000:00010000:2.0:1787862467.695360:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.695370:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862467.695507:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377344:0@lo:501: 00000100:00100000:2.0:1787862467.695532:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.695558:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862467.695764:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377344 00000100:00100000:3.0:1787862467.695769:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377344 00000100:00100000:3.0:1787862467.695799:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787862467.695806:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526377344:12345-0@lo:501: 00000100:00100000:3.0:1787862467.696083:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526377344:12345-0@lo:501: Request processed in 277us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862467.696090:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787862467.696514:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377344:0@lo:501: 00000100:00100000:2.0:1787862467.696546:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377472:0@lo:503: 00000100:00100000:2.0:1787862467.696595:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.696627:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862467.697534:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377472 00000100:00100000:3.0:1787862467.697542:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377472 00000100:00100000:3.0:1787862467.697589:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787862467.697598:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526377472:12345-0@lo:503: 00000100:00100000:3.0:1787862467.697775:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526377472:12345-0@lo:503: Request processed in 178us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862467.697782:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787862467.698240:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377472:0@lo:503: 00000100:00100000:3.0:1787862467.702789:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8460:1874709526377600:0@lo:502: 00000100:00100000:3.0:1787862467.702883:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.702927:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.707070:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377600 00000100:00100000:0.0:1787862467.707085:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377600 00000100:00100000:0.0:1787862467.707140:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787862467.707150:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:8460:x1874709526377600:12345-0@lo:502: 00000100:00100000:0.0:1787862467.707423:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:8460:x1874709526377600:12345-0@lo:502: Request processed in 263us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.707431:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787862467.707702:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8460:1874709526377600:0@lo:502: 00000020:01000000:3.0:1787862467.707738:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862467.707747:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862467.707749:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787862467.707754:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787862467.707783:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8460:1874709526377728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862467.707826:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.707866:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862467.708248:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377728 00000100:00100000:2.0:1787862467.708254:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377728 00000100:00100000:2.0:1787862467.708300:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787862467.708309:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:8460:x1874709526377728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.708458:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:8460:x1874709526377728:12345-0@lo:502:llog_process_th.0 Request processed in 150us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862467.708465:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787862467.708668:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8460:1874709526377728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862467.708690:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862467.708694:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862467.708696:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787862467.708700:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787862467.708930:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787862467.708950:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787862467.708959:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.708970:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862467.708980:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787862467.708982:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a653d6d2000 from 39 10000000:01000000:2.0:1787862467.708985:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862467.709008:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.709016:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.709025:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862467.709068:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.709107:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.709134:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862467.709190:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377856 00000100:00100000:3.0:1787862467.709194:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377856 00000100:00100000:3.0:1787862467.709226:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787862467.709234:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:5813:x1874709526377856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862467.709242:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862467.709253:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501685a00/0x9c5536ccf892fcbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fcb7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.709282:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501685a00/0x9c5536ccf892fcbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fcb7 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.709292:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501685a00/0x9c5536ccf892fcbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fcb7 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.709312:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501685a00, rc 0) 00000100:00100000:3.0:1787862467.709352:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526377856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862467.709359:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787862467.709433:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862467.709445:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862467.709454:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862467.709494:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.709528:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.709553:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.709755:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526377984 00000100:00100000:0.0:1787862467.709759:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526377984 00000100:00100000:0.0:1787862467.709788:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787862467.709796:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526377984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.710014:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526377984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.710029:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787862467.710430:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526377984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.710461:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.710498:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.710536:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.710698:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378112 00000100:00100000:0.0:1787862467.710703:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378112 00000100:00100000:0.0:1787862467.710735:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787862467.710742:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526378112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.710884:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526378112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.710891:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787862467.710994:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.711465:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8461:1874709526378240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.711497:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.711530:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862467.711620:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378240 00000100:00100000:3.0:1787862467.711625:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378240 00000100:00100000:3.0:1787862467.711652:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787862467.711659:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:8461:x1874709526378240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862467.711811:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:8461:x1874709526378240:12345-0@lo:502:llog_process_th.0 Request processed in 152us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862467.711818:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787862467.711957:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8461:1874709526378240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.711994:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8461:1874709526378368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.712024:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.712075:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862467.712152:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378368 00000100:00100000:3.0:1787862467.712156:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378368 00000100:00100000:3.0:1787862467.712181:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787862467.712186:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:8461:x1874709526378368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862467.712310:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:8461:x1874709526378368:12345-0@lo:502:llog_process_th.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862467.712316:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787862467.712431:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8461:1874709526378368:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787862467.712447:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787862467.712659:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787862467.712677:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787862467.712687:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.712699:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862467.712719:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787862467.712721:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787862467.712724:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787862467.712744:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.712751:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862467.712759:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862467.712771:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862467.712795:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.712821:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.712862:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378496 00000100:00100000:0.0:1787862467.712866:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378496 00000100:00100000:0.0:1787862467.712896:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787862467.712902:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:5813:x1874709526378496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862467.712911:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862467.712923:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918c00/0x9c5536ccf892fccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fcc5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.712942:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918c00/0x9c5536ccf892fccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fcc5 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.712952:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918c00/0x9c5536ccf892fccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fcc5 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.712961:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918c00, rc 0) 00000100:00100000:0.0:1787862467.712992:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526378496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.713007:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787862467.713066:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862467.713076:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.713085:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862467.713121:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.713142:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862467.713153:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.713161:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378624 00000100:00100000:0.0:1787862467.713164:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378624 00000100:00100000:0.0:1787862467.713177:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787862467.713182:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526378624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.713654:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526378624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 470us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.713661:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787862467.718357:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862467.718497:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862467.718640:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.719111:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.722194:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378752 00000100:00100000:0.0:1787862467.722207:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378752 00000100:00100000:1.0:1787862467.722315:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787862467.722326:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526378752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862467.722785:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526378752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 458us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862467.722793:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787862467.722901:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.727208:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8462:1874709526378880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.727490:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.727578:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.735622:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526378880 00000100:00100000:0.0:1787862467.735640:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526378880 00000100:00100000:0.0:1787862467.735737:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787862467.735747:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:8462:x1874709526378880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862467.736061:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:8462:x1874709526378880:12345-0@lo:502:llog_process_th.0 Request processed in 295us (8550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.736076:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787862467.744129:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8462:1874709526378880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862467.744175:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862467.744185:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862467.744188:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787862467.744194:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787862467.744229:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8462:1874709526379008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.744305:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.744345:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.745214:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379008 00000100:00100000:0.0:1787862467.745222:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379008 00000100:00100000:0.0:1787862467.745328:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787862467.745339:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:8462:x1874709526379008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862467.745596:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:8462:x1874709526379008:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.745604:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787862467.745663:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8462:1874709526379008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862467.745687:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862467.745693:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862467.745695:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787862467.745700:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787862467.746083:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787862467.746105:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787862467.746114:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.746125:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862467.746135:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787862467.746143:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a65091a1800 from 39 10000000:01000000:1.0:1787862467.746147:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787862467.746175:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.746183:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.746193:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862467.746211:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862467.746244:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862467.746266:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502c9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.746895:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379136 00000100:00100000:0.0:1787862467.746900:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379136 00000100:00100000:0.0:1787862467.746938:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787862467.746946:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526379136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862467.747328:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862467.747344:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919c00/0x9c5536ccf892fcda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fcd3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.747366:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919c00/0x9c5536ccf892fcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fcd3 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.747376:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919c00/0x9c5536ccf892fcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fcd3 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.747393:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919c00, rc 0) 00000100:00100000:0.0:1787862467.747443:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526379136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 498us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.747450:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787862467.747502:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862467.747516:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.747605:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862467.747648:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862467.747668:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862467.747694:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502c9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.747702:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379264 00000100:00100000:0.0:1787862467.747706:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379264 00000100:00100000:0.0:1787862467.747739:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787862467.747748:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526379264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.748112:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526379264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.748120:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787862467.748212:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862467.748241:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862467.748341:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862467.748366:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.748404:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379392 00000100:00100000:0.0:1787862467.748408:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379392 00000100:00100000:0.0:1787862467.748462:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787862467.748469:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526379392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.748609:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526379392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.748616:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787862467.753536:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862467.761034:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8465:1874709526379520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.761139:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.761184:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.761244:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379520 00000100:00100000:0.0:1787862467.761260:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379520 00000100:00100000:0.0:1787862467.761302:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787862467.761312:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8465:x1874709526379520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862467.761550:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8465:x1874709526379520:12345-0@lo:502:llog_process_th.0 Request processed in 239us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.761564:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787862467.761821:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8465:1874709526379520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.761864:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8465:1874709526379648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862467.761895:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862467.761924:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862467.762066:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379648 00000100:00100000:1.0:1787862467.762071:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379648 00000100:00100000:1.0:1787862467.762100:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787862467.762107:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8465:x1874709526379648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862467.762241:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8465:x1874709526379648:12345-0@lo:502:llog_process_th.0 Request processed in 133us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862467.762264:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787862467.762760:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8465:1874709526379648:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787862467.762781:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787862467.762966:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787862467.762987:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862467.762997:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.763008:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862467.763018:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787862467.763020:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787862467.763023:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862467.763078:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.763088:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.763097:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862467.763113:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.763146:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862467.763173:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787862467.763448:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379776 00000100:00100000:1.0:1787862467.763453:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379776 00000100:00100000:1.0:1787862467.763487:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787862467.763495:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526379776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862467.763504:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862467.763516:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fce1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.763536:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fce1 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.763545:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fce1 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.763554:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45400, rc 0) 00000100:00100000:1.0:1787862467.763597:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526379776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862467.763604:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787862467.763717:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862467.763731:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.763753:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862467.763807:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.763843:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862467.763865:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.763878:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526379904 00000100:00100000:0.0:1787862467.763881:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526379904 00000100:00100000:0.0:1787862467.763900:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787862467.763906:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526379904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.764176:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526379904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.764184:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787862467.764209:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526379904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.764233:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526380032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.764278:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862467.764297:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.764307:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380032 00000100:00100000:0.0:1787862467.764310:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380032 00000100:00100000:0.0:1787862467.764326:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787862467.764332:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526380032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.764465:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526380032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.764471:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787862467.764511:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526380032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.767010:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8467:1874709526380160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862467.767097:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862467.767129:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380160 00000100:00100000:0.0:1787862467.767135:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380160 00000100:00100000:0.0:1787862467.767172:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787862467.767179:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8467:x1874709526380160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862467.767501:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8467:x1874709526380160:12345-0@lo:502:llog_process_th.0 Request processed in 321us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.767509:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787862467.767557:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.767587:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8467:1874709526380160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862467.767615:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862467.767624:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862467.767626:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787862467.767633:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787862467.767653:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8467:1874709526380288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862467.767685:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862467.767698:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862467.767970:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380288 00000100:00100000:1.0:1787862467.767975:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380288 00000100:00100000:1.0:1787862467.768004:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787862467.768012:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8467:x1874709526380288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862467.768167:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8467:x1874709526380288:12345-0@lo:502:llog_process_th.0 Request processed in 155us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862467.768174:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787862467.768915:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8467:1874709526380288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862467.768941:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862467.768946:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862467.768948:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787862467.768951:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787862467.774438:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787862467.774480:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787862467.774492:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.774505:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862467.774516:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787862467.774519:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a653aa2b490 from 1 10000000:01000000:1.0:1787862467.774522:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787862467.774555:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.774564:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.774583:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862467.774609:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526380416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862467.774675:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862467.774756:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.775863:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380416 00000100:00100000:0.0:1787862467.775872:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380416 00000100:00100000:0.0:1787862467.775927:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787862467.775944:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526380416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862467.776069:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862467.776084:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918400/0x9c5536ccf892fcf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fcef expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.776111:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918400/0x9c5536ccf892fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fcef expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.776121:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918400/0x9c5536ccf892fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fcef expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862467.776129:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918400, rc 0) 00000100:00100000:0.0:1787862467.776179:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526380416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862467.776186:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787862467.776282:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526380416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862467.776297:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.776306:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862467.776367:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862467.776407:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862467.776436:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6506598240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862467.776522:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380544 00000100:00100000:0.0:1787862467.776527:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380544 00000100:00100000:0.0:1787862467.776556:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787862467.776564:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526380544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862467.777935:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526380544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1367us (1524us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787862467.777946:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787862467.778451:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526380544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787862467.778487:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787862467.778496:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862467.778507:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.125063:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787862468.174125:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff94fb7d60 20000000:00000080:0.0:1787862468.174148:0:8494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a64011e5400 uarg=0000000000000000 20000000:01000000:0.0:1787862468.174187:0:8494:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787862468.174194:0:8494:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787862468.174199:0:8494:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787862468.187669:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787862468.195668:0:8494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787862468.207971:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787862468.208026:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787862468.208147:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787862468.208166:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787862468.208193:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208211:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208220:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892facd expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208228:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208238:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208245:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208459:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208475:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 9 pid: 5809 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.208489:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526380672:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862468.208791:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.208801:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 18 pid: 5809 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.208823:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526380800:0@lo:104: 00000100:00100000:2.0:1787862468.209241:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787862468.209285:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892facd expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209295:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892facd expref: 18 pid: 5810 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.209304:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526380928:0@lo:104: 00000100:00100000:2.0:1787862468.209331:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862468.209361:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787862468.209372:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380800 00000100:00100000:2.0:1787862468.209378:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380800 00000100:00100000:2.0:1787862468.209413:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526380928 00000100:00100000:2.0:1787862468.209416:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526380928 00000100:00100000:2.0:1787862468.209430:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862468.209438:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:8494:x1874709526380800:12345-0@lo:104: 00010000:00010000:2.0:1787862468.209450:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209494:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862468.209500:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:8494:x1874709526380800:12345-0@lo:104: Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862468.209507:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862468.209527:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862468.209533:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:8494:x1874709526380928:12345-0@lo:104: 00010000:00010000:2.0:1787862468.209541:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209590:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787862468.209596:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:8494:x1874709526380928:12345-0@lo:104: Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862468.209603:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787862468.209636:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862468.209643:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209651:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862468.209655:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209664:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862468.209672:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862468.209677:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787862468.209701:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209708:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862468.209725:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209733:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af45000/0x9c5536ccf892fb98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fb9f expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209756:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862468.209760:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209766:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862468.209769:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209777:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862468.209783:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862468.209788:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787862468.209801:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209807:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862468.209813:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209820:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6500030c00/0x9c5536ccf892facd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fad4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209830:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862468.209831:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862468.209833:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862468.209864:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209880:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 18 pid: 5808 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.209889:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526381312:0@lo:104: 00000100:00100000:2.0:1787862468.209912:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862468.209930:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381312 00000100:00100000:2.0:1787862468.209934:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381312 00000100:00100000:2.0:1787862468.209953:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862468.209959:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:8494:x1874709526381312:12345-0@lo:104: 00010000:00010000:2.0:1787862468.209967:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.209994:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862468.209999:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:8494:x1874709526381312:12345-0@lo:104: Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862468.210006:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862468.210024:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509956e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862468.210067:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526380800:0@lo:104: 00000100:00100000:2.0:1787862468.210078:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526380928:0@lo:104: 00000100:00100000:2.0:1787862468.210085:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526381312:0@lo:104: 00000100:00100000:1.0:1787862468.210460:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526381056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862468.210492:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862468.210528:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862468.210534:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526381184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862468.210553:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862468.213653:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862468.213666:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862468.213677:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862468.213681:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862468.213690:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862468.213697:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862468.213702:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787862468.213742:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862468.213749:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862468.213771:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862468.213778:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc600/0x9c5536ccf892fa6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fa72 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862468.213794:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862468.213796:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862468.213798:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862468.213813:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862468.213831:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526381440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862468.213904:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862468.214787:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381056 00000100:00100000:2.0:1787862468.214797:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381056 00010000:00010000:2.0:1787862468.214832:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 19 pid: 5809 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.214876:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381184 00000100:00100000:2.0:1787862468.214880:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381184 00010000:00010000:2.0:1787862468.215622:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892facd expref: 20 pid: 5810 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.215638:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381440 00000100:00100000:2.0:1787862468.215641:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381440 00010000:00010000:2.0:1787862468.215651:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 21 pid: 5808 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.215663:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862468.215672:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+21:3283:x1874709526381056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862468.215687:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862468.215693:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 21 pid: 5809 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215704:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 21 pid: 5809 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215721:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fb9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fb98 expref: 21 pid: 5809 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215736:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862468.215801:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+20:3283:x1874709526381056:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (5307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862468.215808:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787862468.215828:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862468.215835:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526381184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862468.215843:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862468.215847:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892facd expref: 19 pid: 5810 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215878:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892facd expref: 19 pid: 5810 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215888:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfcc00/0x9c5536ccf892fad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892facd expref: 19 pid: 5810 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215898:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862468.215923:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3283:x1874709526381184:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862468.215929:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862468.215942:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862468.215948:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3282:x1874709526381440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862468.215956:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862468.215960:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 17 pid: 5808 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215968:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 17 pid: 5808 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215977:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fa72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fa6b expref: 17 pid: 5808 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.215986:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862468.216012:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3282:x1874709526381440:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862468.216019:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787862468.216099:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862468.216235:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526381440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862468.217428:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526381184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862468.217440:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526381056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862468.225779:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862468.225881:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916224 00000100:00100000:3.0:1787862468.225891:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916224 00010000:00010000:3.0:1787862468.225931:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 10 pid: 5809 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862468.225988:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:3.0:1787862468.225997:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516916224:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862468.226013:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862468.226019:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 10 pid: 5809 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226032:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 10 pid: 5809 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226089:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226098:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226115:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226122:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226129:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226135:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226140:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862468.226145:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226158:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226166:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862468.226176:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862468.226224:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516916224:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 227us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862468.226231:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00010000:00010000:2.0:1787862468.226829:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919000/0x9c5536ccf892fc5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3459f expref: 9 pid: 5809 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862468.226864:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874709526380672:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862468.226902:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.226911:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.226917:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862468.226924:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fcfd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.148195:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862469.159739:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862469.159748:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a651c992800 from 4 10000000:01000000:2.0:1787862469.159754:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862469.159805:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.159817:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.159829:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862469.159860:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526381568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.159949:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.159999:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862469.165157:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381568 00000100:00100000:0.0:1787862469.165174:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381568 00000100:00100000:0.0:1787862469.165257:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787862469.165269:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526381568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862469.165289:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862469.165313:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fd04 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.165341:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.165370:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.165381:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918200, rc 0) 00000100:00100000:0.0:1787862469.165488:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526381568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (5537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.165496:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787862469.167579:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526381568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862469.167606:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862469.167619:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862469.167688:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526381696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.167747:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.167786:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.171991:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381696 00000100:00100000:3.0:1787862469.172006:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381696 00000100:00100000:3.0:1787862469.172074:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787862469.172086:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526381696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.172433:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526381696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.172441:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787862469.177183:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526381696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.177269:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526381824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.177361:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.177423:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.177576:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381824 00000100:00100000:3.0:1787862469.177584:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381824 00000100:00100000:3.0:1787862469.177639:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787862469.177650:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526381824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.177895:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526381824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.177902:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787862469.178773:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526381824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.179654:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8512:1874709526381952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862469.179712:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.179845:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6512025600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.179901:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526381952 00000100:00100000:3.0:1787862469.179910:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526381952 00000100:00100000:3.0:1787862469.179951:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787862469.179963:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8512:x1874709526381952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862469.180670:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8512:x1874709526381952:12345-0@lo:502:llog_process_th.0 Request processed in 705us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.180679:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787862469.181156:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8512:1874709526381952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862469.181201:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862469.181214:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.181216:0:8512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787862469.181226:0:8512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a651c992800 00000020:00000080:0.0:1787862469.181228:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787862469.181307:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8512:1874709526382080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862469.181364:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.181401:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862469.181544:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382080 00000100:00100000:1.0:1787862469.181550:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382080 00000100:00100000:1.0:1787862469.181606:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787862469.181616:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8512:x1874709526382080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862469.181813:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:8512:x1874709526382080:12345-0@lo:502:llog_process_th.0 Request processed in 198us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.181821:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787862469.181849:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8512:1874709526382080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862469.181873:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862469.181878:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862469.181881:0:8512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787862469.181888:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787862469.181973:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787862469.181993:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862469.182003:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.182014:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862469.182024:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862469.182027:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a653d6d2000 from 4 10000000:01000000:1.0:1787862469.182030:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862469.182073:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.182082:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.182090:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862469.182105:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862469.182134:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.182159:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517abc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862469.182597:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382208 00000100:00100000:0.0:1787862469.182603:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382208 00000100:00100000:0.0:1787862469.182646:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787862469.182655:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526382208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862469.182665:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862469.182678:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fd12 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.182787:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.182800:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.182808:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919800, rc 0) 00000100:00100000:0.0:1787862469.182900:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526382208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.182906:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787862469.192496:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862469.192645:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862469.192660:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862469.192753:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862469.192820:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862469.192871:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517abc900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.201113:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382336 00000100:00100000:3.0:1787862469.201133:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382336 00000100:00100000:3.0:1787862469.201199:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787862469.201211:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526382336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.201607:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526382336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (8784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.201616:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787862469.201636:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.201697:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.201743:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.201776:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65120259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862469.201793:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382464 00000100:00100000:2.0:1787862469.201798:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382464 00000100:00100000:2.0:1787862469.201834:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862469.201848:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526382464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862469.202007:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526382464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.202014:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862469.202165:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.205430:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8516:1874709526382592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862469.205536:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.205586:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382592 00000100:00100000:3.0:1787862469.205592:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382592 00000100:00100000:3.0:1787862469.205628:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787862469.205639:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8516:x1874709526382592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862469.205849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8516:x1874709526382592:12345-0@lo:502:llog_process_th.0 Request processed in 211us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.205857:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787862469.205902:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.205948:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8516:1874709526382592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862469.205974:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862469.205983:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862469.205985:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787862469.205990:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a653d6d2000 00000020:00000080:3.0:1787862469.205999:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787862469.206436:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8516:1874709526382720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862469.206472:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.206495:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382720 00000100:00100000:3.0:1787862469.206499:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382720 00000100:00100000:3.0:1787862469.206521:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787862469.206529:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8516:x1874709526382720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787862469.206653:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:8516:x1874709526382720:12345-0@lo:502:llog_process_th.0 Request processed in 124us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.206661:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787862469.206688:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.206702:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8516:1874709526382720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787862469.206718:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862469.206722:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862469.206724:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787862469.206728:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787862469.206776:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787862469.206794:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862469.206803:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.206814:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862469.206824:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787862469.206826:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a65091a1800 from 4 10000000:01000000:3.0:1787862469.206829:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862469.206852:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.206871:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.206881:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862469.206896:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.206923:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.206937:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.206950:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382848 00000100:00100000:3.0:1787862469.206954:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382848 00000100:00100000:3.0:1787862469.206974:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787862469.206980:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526382848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862469.206989:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862469.206999:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fd20 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.207020:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.207031:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.207039:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501684600, rc 0) 00000100:00100000:3.0:1787862469.207091:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526382848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.207097:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787862469.207133:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862469.207145:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.207154:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862469.207192:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.207217:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.207229:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.207240:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526382976 00000100:00100000:3.0:1787862469.207243:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526382976 00000100:00100000:3.0:1787862469.207263:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787862469.207268:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526382976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.207465:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526382976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.207473:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787862469.207504:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526382976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.207527:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526383104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.207590:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862469.207602:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862469.207611:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383104 00000100:00100000:3.0:1787862469.207614:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383104 00000100:00100000:3.0:1787862469.207632:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787862469.207638:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526383104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.207748:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526383104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.207759:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787862469.207793:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526383104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862469.217967:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8517:1874709526383232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862469.219466:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.221812:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651149ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862469.229828:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383232 00000100:00100000:0.0:1787862469.229843:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383232 00000100:00100000:0.0:1787862469.229918:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787862469.229930:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:8517:x1874709526383232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862469.230239:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:8517:x1874709526383232:12345-0@lo:502:llog_process_th.0 Request processed in 311us (10778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.230253:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787862469.230883:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8517:1874709526383232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862469.230922:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862469.230932:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.230934:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787862469.230941:0:8517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a65091a1800 00000020:00000080:2.0:1787862469.230944:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787862469.231024:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8517:1874709526383360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862469.231303:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.231333:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383360 00000100:00100000:2.0:1787862469.231339:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383360 00000100:00100000:2.0:1787862469.231381:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787862469.231389:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:8517:x1874709526383360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862469.231621:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:8517:x1874709526383360:12345-0@lo:502:llog_process_th.0 Request processed in 232us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.231628:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787862469.231670:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65120259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862469.231682:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faebc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:8517:1874709526383360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862469.231701:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862469.231706:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862469.231712:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787862469.231715:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787862469.236147:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787862469.236216:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862469.236228:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862469.236240:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862469.291943:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526383872:0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.292032:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.292112:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862469.292119:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526383488:0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.292159:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.292179:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526384000:0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.292214:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.292237:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526383616:0@lo:400:kworker.0 00000100:00100000:2.0:1787862469.292403:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526383744:0@lo:400:kworker.0 00000100:00100000:2.0:1787862469.292436:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862469.292472:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384000 00000100:00100000:2.0:1787862469.292480:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384000 00000100:00100000:2.0:1787862469.292533:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383744 00000100:00100000:2.0:1787862469.292536:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383744 00000100:00100000:2.0:1787862469.292572:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787862469.292582:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862469.292637:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526384000:12345-0@lo:400:kworker.0 Request processed in 56us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.292645:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787862469.292665:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787862469.292672:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862469.292702:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526383744:12345-0@lo:400:kworker.0 Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.292708:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787862469.292724:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862469.292761:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526384000:0@lo:400:kworker.0 00000100:00100000:2.0:1787862469.292788:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526383744:0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.292834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.292860:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526384128:0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.292885:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.292917:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383488 00000100:00100000:0.0:1787862469.292921:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383488 00000100:00100000:0.0:1787862469.292946:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787862469.292952:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.292985:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526383488:12345-0@lo:400:kworker.0 Request processed in 32us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.293003:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787862469.293033:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383616 00000100:00100000:0.0:1787862469.293037:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383616 00000100:00100000:0.0:1787862469.293087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862469.293094:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.293128:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526383616:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.293134:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862469.293151:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526383872 00000100:00100000:0.0:1787862469.293154:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526383872 00000100:00100000:0.0:1787862469.293181:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384128 00000100:00100000:2.0:1787862469.294533:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526383488:0@lo:400:kworker.0 00000100:00080000:2.0:1787862469.294573:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862469.294625:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384128 00000100:00100000:0.0:1787862469.294679:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862469.294688:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.294753:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526383872:12345-0@lo:400:kworker.0 Request processed in 67us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.294759:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862469.294772:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862469.294778:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526384128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862469.294806:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526384128:12345-0@lo:400:kworker.0 Request processed in 29us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.294811:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862469.294840:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526383616:0@lo:400:kworker.0 00010000:00080000:0.0:1787862469.294853:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ee8f00 x1874709526384128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862469.294863:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526384128:0@lo:400:kworker.0 00000100:00080000:2.0:1787862469.295305:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787862469.295328:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ee9a40 x1874709526383872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862469.295352:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526383872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862469.711381:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862469.711786:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916352 00000100:00100000:3.0:1787862469.711796:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916352 00000100:00100000:3.0:1787862469.714674:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:3.0:1787862469.714695:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:5592:x1874709516916352:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862469.714720:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862469.714744:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b345de expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.719006:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.719038:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862469.719064:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501684a00, rc 0) 00000100:00100000:3.0:1787862469.719161:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916352:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 4472us (7785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.719170:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:2.0:1787862469.732810:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862469.732884:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916480 00000100:00100000:3.0:1787862469.732894:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916480 00000100:00100000:3.0:1787862469.732950:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 188 00000100:00100000:3.0:1787862469.732960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916480:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862469.733251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916480:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 292us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862469.733268:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 188 00000100:00100000:3.0:1787862469.744436:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862469.747753:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916608 00000100:00100000:0.0:1787862469.747772:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916608 00000100:00100000:0.0:1787862469.747853:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 189 00000100:00100000:0.0:1787862469.747864:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916608:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862469.748132:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:5592:x1874709516916608:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 268us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.748141:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 189 00000100:00100000:2.0:1787862469.757374:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862469.765575:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916736 00000100:00100000:1.0:1787862469.765591:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916736 00000100:00100000:1.0:1787862469.765666:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 190 00000100:00100000:1.0:1787862469.765678:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:6114:x1874709516916736:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862469.765941:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:6114:x1874709516916736:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 264us (8582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862469.765949:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 190 00000100:00100000:1.0:1787862469.785811:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862469.785889:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916864 00000100:00100000:2.0:1787862469.785901:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916864 00000100:00100000:2.0:1787862469.785959:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:2.0:1787862469.785970:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:6114:x1874709516916864:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862469.786260:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:6114:x1874709516916864:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 282us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862469.786269:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:0.0:1787862469.788237:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862469.788268:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526384256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862469.788330:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862469.788390:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384256 00000100:00100000:0.0:1787862469.788396:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384256 00000100:00100000:0.0:1787862469.788434:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862469.788443:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526384256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862469.788478:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862469.788520:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526384256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862469.788527:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787862469.788577:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6516829a40 x1874709526384256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862469.788597:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526384256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862470.178569:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862470.346732:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862470.346787:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862470.346824:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862470.346845:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862470.346880:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917376 00000100:00100000:3.0:1787862470.346892:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917376 00000100:00100000:3.0:1787862470.346950:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917248 00000100:00100000:3.0:1787862470.346953:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917248 00000100:00100000:3.0:1787862470.346972:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:3.0:1787862470.346993:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516917376:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862470.347104:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516917376:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862470.347112:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:3.0:1787862470.347129:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862470.347136:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516917248:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862470.347162:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516917248:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862470.347168:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:2.0:1787862470.347454:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917120 00000100:00100000:2.0:1787862470.347459:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917120 00000100:00100000:2.0:1787862470.347501:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:2.0:1787862470.347509:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516917120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862470.347541:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516917120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862470.347559:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:2.0:1787862470.347582:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516916992 00000100:00100000:2.0:1787862470.347586:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516916992 00000100:00100000:2.0:1787862470.347609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00100000:2.0:1787862470.347615:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2347:x1874709516916992:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862470.347639:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2347:x1874709516916992:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862470.347645:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00080000:2.0:1787862470.347686:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862470.347691:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862470.347693:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787862471.201267:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862471.330549:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526384384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862471.330641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862471.330882:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384384 00000100:00100000:0.0:1787862471.330891:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384384 00000100:00100000:0.0:1787862471.330959:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862471.330968:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526384384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862471.331027:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862471.331105:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526384384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862471.331114:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787862471.331514:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862471.331566:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6516829a40 x1874709526384384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862471.331587:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526384384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862472.220307:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862473.252194:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862474.268734:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862474.396708:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526384512:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.396785:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.396842:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526385024:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.396872:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.396909:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862474.396916:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526384896:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.396941:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.396969:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526384640:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.396993:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.397010:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526385152:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397030:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.397068:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862474.397073:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526384768:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397094:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.397127:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384512 00000100:00100000:3.0:1787862474.397134:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384512 00000100:00100000:3.0:1787862474.397176:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787862474.397185:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526384512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397246:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526384512:12345-0@lo:400:kworker.0 Request processed in 61us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.397254:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787862474.397283:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385024 00000100:00100000:3.0:1787862474.397287:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385024 00000100:00100000:3.0:1787862474.397334:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384640 00000100:00100000:3.0:1787862474.397337:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384640 00000100:00100000:3.0:1787862474.397348:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384768 00000100:00100000:3.0:1787862474.397351:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384768 00000100:00100000:3.0:1787862474.397369:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862474.397376:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526385024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397407:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526385024:12345-0@lo:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.397427:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862474.397448:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787862474.397454:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526384640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397733:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526384640:12345-0@lo:400:kworker.0 Request processed in 278us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.397740:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787862474.397753:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787862474.397760:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526384768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397788:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526384768:12345-0@lo:400:kworker.0 Request processed in 29us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.397794:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787862474.397813:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526384896 00000100:00100000:3.0:1787862474.397817:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526384896 00000100:00100000:3.0:1787862474.397844:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385152 00000100:00100000:3.0:1787862474.397848:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385152 00000100:00100000:3.0:1787862474.397862:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787862474.397868:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526384896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397898:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526384896:12345-0@lo:400:kworker.0 Request processed in 30us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.397904:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787862474.397915:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787862474.397920:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526385152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.397946:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526385152:12345-0@lo:400:kworker.0 Request processed in 26us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.397952:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787862474.397980:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862474.397984:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862474.397987:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862474.398068:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526384768:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.398084:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526384640:0@lo:400:kworker.0 00010000:00080000:3.0:1787862474.398097:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e0b480 x1874709526385152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862474.398107:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526385152:0@lo:400:kworker.0 00010000:00080000:3.0:1787862474.398139:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e0bc00 x1874709526384896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862474.398149:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526384896:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.398159:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526384512:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.398168:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526385024:0@lo:400:kworker.0 00000100:00100000:3.0:1787862474.931140:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862474.931167:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526385280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862474.931262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862474.931343:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385280 00000100:00100000:3.0:1787862474.931350:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385280 00000100:00100000:3.0:1787862474.931400:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787862474.931409:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526385280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862474.931448:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862474.931493:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526385280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862474.931500:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787862474.931560:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e0a1c0 x1874709526385280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862474.931595:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526385280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862475.293553:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862475.473074:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862475.473344:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862475.473373:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862475.473402:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862475.473433:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917760 00000100:00100000:0.0:1787862475.473443:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917760 00000100:00100000:0.0:1787862475.473531:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917888 00000100:00100000:0.0:1787862475.473534:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917888 00000100:00100000:0.0:1787862475.473556:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1787862475.473567:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516917760:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862475.473642:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516917760:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862475.473650:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1787862475.473667:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1787862475.473673:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516917888:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862475.473697:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516917888:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862475.473703:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:3.0:1787862475.474298:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917504 00000100:00100000:3.0:1787862475.474304:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917504 00000100:00100000:3.0:1787862475.474366:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 194 00000100:00100000:3.0:1787862475.474374:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516917504:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862475.474404:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516917504:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862475.474410:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 194 00000100:00100000:0.0:1787862475.474472:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516917632 00000100:00100000:0.0:1787862475.474476:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516917632 00000100:00100000:0.0:1787862475.474526:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1787862475.474534:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516917632:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862475.474574:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516917632:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 42us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862475.474581:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00080000:0.0:1787862475.474602:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862475.474606:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862475.474609:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862476.320234:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862476.444272:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526385408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862476.444354:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862476.444501:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385408 00000100:00100000:2.0:1787862476.444510:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385408 00000100:00100000:2.0:1787862476.444581:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862476.444594:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526385408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862476.444634:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862476.444688:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526385408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862476.444696:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787862476.444757:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fae8000 x1874709526385408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862476.444777:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526385408:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862476.444843:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862477.352602:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862477.684776:0:8794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787862478.364461:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862479.405672:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862479.533697:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526385664:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.533769:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862479.533833:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526386176:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.533874:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862479.535981:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526385536:0@lo:400:kworker.0 00000100:00100000:0.0:1787862479.536075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862479.536124:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526385792:0@lo:400:kworker.0 00000100:00100000:0.0:1787862479.536153:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862479.536194:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385536 00000100:00100000:0.0:1787862479.536202:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385536 00000100:00100000:0.0:1787862479.536254:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787862479.536264:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526385536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862479.536318:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526385536:12345-0@lo:400:kworker.0 Request processed in 55us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862479.536325:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787862479.536355:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385664 00000100:00100000:0.0:1787862479.536359:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385664 00000100:00100000:0.0:1787862479.536383:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385792 00000100:00100000:0.0:1787862479.536386:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385792 00000100:00100000:0.0:1787862479.536413:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862479.536432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526385664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862479.536492:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526385664:12345-0@lo:400:kworker.0 Request processed in 73us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862479.536498:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862479.536510:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862479.536517:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526385792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862479.536548:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526385792:12345-0@lo:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862479.536554:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787862479.536576:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862479.536858:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526385664:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.536903:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386176 00000100:00100000:2.0:1787862479.536910:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386176 00000100:00100000:2.0:1787862479.536945:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862479.536952:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526386176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.536991:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526386176:12345-0@lo:400:kworker.0 Request processed in 40us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862479.536997:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862479.537032:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526385536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.537058:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526386048:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.537086:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862479.537114:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862479.537121:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526385920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.537143:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787862479.537179:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862479.537188:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526385920 00000100:00100000:2.0:1787862479.537192:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526385920 00000100:00100000:2.0:1787862479.537220:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862479.537226:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.537259:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526385920:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862479.537265:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862479.537289:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526385792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.537317:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386048 00000100:00100000:2.0:1787862479.537320:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386048 00000100:00100000:2.0:1787862479.537340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787862479.537346:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.537374:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526386048:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862479.537379:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787862479.537393:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862479.537396:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862479.537414:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518eea580 x1874709526385920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862479.539115:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526385920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862479.539143:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526386048:0@lo:400:kworker.0 00010000:00080000:2.0:1787862479.539255:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ee9680 x1874709526386176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862479.539266:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526386176:0@lo:400:kworker.0 00000100:00100000:3.0:1787862480.050014:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526386304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862480.050100:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862480.050192:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386304 00000100:00100000:3.0:1787862480.050199:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386304 00000100:00100000:3.0:1787862480.050245:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787862480.050254:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526386304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862480.050310:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862480.050356:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526386304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862480.050363:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787862480.050428:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e0bc00 x1874709526386304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862480.050472:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526386304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862480.413685:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862480.611899:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862480.611963:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862480.611990:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862480.612129:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918016 00000100:00100000:3.0:1787862480.612139:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918016 00000100:00100000:3.0:1787862480.612205:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 196 00000100:00100000:3.0:1787862480.612217:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516918016:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862480.612289:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516918016:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 74us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862480.612296:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 196 00000100:00100000:0.0:1787862480.613095:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862480.613360:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918144 00000100:00100000:1.0:1787862480.613367:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918144 00000100:00100000:1.0:1787862480.613441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787862480.613460:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516918144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862480.613514:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516918144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 65us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862480.613522:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00080000:3.0:1787862480.613754:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862480.627940:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918272 00000100:00100000:2.0:1787862480.627956:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918272 00000100:00100000:2.0:1787862480.628074:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918400 00000100:00100000:2.0:1787862480.628079:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918400 00000100:00100000:2.0:1787862480.628117:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787862480.628129:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2345:x1874709516918272:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:2.0:1787862480.628177:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc6a 00000100:00080000:2.0:1787862480.628189:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a65403ae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862480.628228:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787862480.628620:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+2:2345:x1874709516918272:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 493us (16626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862480.628629:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787862480.628646:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787862480.628653:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2345:x1874709516918400:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:2.0:1787862480.628667:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc71 00000100:00080000:2.0:1787862480.628673:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a65403a8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862480.628694:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1787862480.629092:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862480.629098:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862480.629587:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862480.629594:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862480.629725:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+2:2345:x1874709516918400:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 1069us (16629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862480.629733:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00010000:00010000:0.0:1787862481.443520:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862481.565719:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862481.565744:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526386432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862481.565815:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862481.565929:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386432 00000100:00100000:2.0:1787862481.565937:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386432 00000100:00100000:2.0:1787862481.565996:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862481.566007:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526386432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862481.566061:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862481.566120:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526386432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862481.566128:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787862481.566236:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862481.566284:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e4b40 x1874709526386432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862481.566303:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526386432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862482.472003:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862483.503615:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862484.508242:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862484.640172:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526386816:0@lo:400:kworker.0 00000100:00100000:3.0:1787862484.640266:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862484.640325:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787862484.640332:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526386688:0@lo:400:kworker.0 00000100:00100000:3.0:1787862484.640355:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862484.640379:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526387200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862484.640404:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862484.641142:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526386944:0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641179:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862484.641214:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862484.641220:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526386560:0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641245:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862484.641264:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526387072:0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641298:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862484.641338:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386816 00000100:00100000:2.0:1787862484.641345:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386816 00000100:00100000:2.0:1787862484.641397:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386688 00000100:00100000:2.0:1787862484.641400:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386688 00000100:00100000:2.0:1787862484.641427:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387072 00000100:00100000:2.0:1787862484.641430:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387072 00000100:00100000:2.0:1787862484.641451:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862484.641460:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526386816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641517:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526386816:12345-0@lo:400:kworker.0 Request processed in 58us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862484.641525:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862484.641541:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787862484.641548:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526386688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641575:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526386688:12345-0@lo:400:kworker.0 Request processed in 28us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862484.641580:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787862484.641591:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787862484.641597:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526387072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641627:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526387072:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862484.641633:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787862484.641653:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387200 00000100:00100000:2.0:1787862484.641657:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387200 00000100:00100000:2.0:1787862484.641679:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386944 00000100:00100000:2.0:1787862484.641682:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386944 00000100:00100000:2.0:1787862484.641694:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862484.641700:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526387200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641740:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526387200:12345-0@lo:400:kworker.0 Request processed in 40us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862484.641747:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862484.641759:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862484.641766:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526386944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641795:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526386944:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862484.641801:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862484.641819:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526386560 00000100:00100000:2.0:1787862484.641823:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526386560 00000100:00100000:2.0:1787862484.641846:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787862484.641853:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526386560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.641882:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526386560:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862484.641888:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1787862484.641919:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862484.641924:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862484.641927:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862484.641984:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526386688:0@lo:400:kworker.0 00010000:00080000:2.0:1787862484.642003:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3e940 x1874709526387200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862484.642015:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526387200:0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.642031:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526386816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.642100:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526386560:0@lo:400:kworker.0 00000100:00100000:2.0:1787862484.642123:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526387072:0@lo:400:kworker.0 00010000:00080000:2.0:1787862484.642135:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3d680 x1874709526386944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862484.642143:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526386944:0@lo:400:kworker.0 00000001:00100000:0.0:1787862484.766495:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:0.0:1787862484.766513:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a65403ad800/21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:2.0:1787862484.766649:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65403ad800/21567a16-68b5-41a8-a3f6-27f314a231da for lustre-OST0000 00000020:00000080:2.0:1787862484.766733:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65403ae000 for lustre-OST0000 00000100:00100000:1.0:1787862485.151550:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526387328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862485.151688:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862485.152077:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387328 00000100:00100000:0.0:1787862485.152090:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387328 00000100:00100000:0.0:1787862485.152244:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862485.152256:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526387328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862485.152312:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862485.152381:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526387328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862485.152388:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787862485.152853:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa45680 x1874709526387328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862485.152879:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526387328:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787862485.508229:0:9040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing yml_node 00010000:00010000:1.0:1787862485.537727:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862485.706394:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862485.706464:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862485.706892:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918528 00000100:00100000:1.0:1787862485.706907:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918528 00000100:00100000:1.0:1787862485.706970:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 198 00000100:00100000:1.0:1787862485.706984:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516918528:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862485.707128:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516918528:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 147us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862485.707137:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 198 00000100:00100000:1.0:1787862485.709159:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918656 00000100:00100000:1.0:1787862485.709177:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918656 00000100:00100000:1.0:1787862485.709248:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:1.0:1787862485.709259:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516918656:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862485.709345:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516918656:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 88us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862485.709352:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00080000:2.0:1787862485.710413:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787862485.743735:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:0.0:1787862485.743750:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a65403af000/21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:3.0:1787862485.750272:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65403af000/21567a16-68b5-41a8-a3f6-27f314a231da for lustre-OST0001 00000020:00000080:3.0:1787862485.750378:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65403a8800 for lustre-OST0001 00010000:00010000:2.0:1787862486.556344:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862486.685850:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526387456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862486.685952:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862486.686118:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387456 00000100:00100000:2.0:1787862486.686129:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387456 00000100:00100000:2.0:1787862486.686213:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862486.686238:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526387456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862486.686287:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862486.686352:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526387456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862486.686361:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787862486.686423:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e5680 x1874709526387456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862486.686446:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526387456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862486.686504:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862487.590890:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862488.604978:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862489.629920:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862489.756976:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526387584:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757148:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862489.757218:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526388096:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757251:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862489.757308:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862489.757314:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526387968:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757376:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862489.757419:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526387712:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757447:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862489.757463:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526388224:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757486:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862489.757510:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862489.757515:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526387840:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862489.757574:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387584 00000100:00100000:1.0:1787862489.757583:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387584 00000100:00100000:1.0:1787862489.757640:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787862489.757651:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526387584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757710:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526387584:12345-0@lo:400:kworker.0 Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.757719:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787862489.757757:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388096 00000100:00100000:1.0:1787862489.757761:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388096 00000100:00100000:1.0:1787862489.757795:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387712 00000100:00100000:1.0:1787862489.757798:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387712 00000100:00100000:1.0:1787862489.757811:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387840 00000100:00100000:1.0:1787862489.757814:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387840 00000100:00100000:1.0:1787862489.757829:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862489.757835:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757872:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526388096:12345-0@lo:400:kworker.0 Request processed in 36us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.757878:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862489.757897:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862489.757903:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526387712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757939:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526387712:12345-0@lo:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.757945:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862489.757956:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787862489.757963:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526387840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.757988:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526387840:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.757994:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787862489.758013:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526387968 00000100:00100000:1.0:1787862489.758017:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526387968 00000100:00100000:1.0:1787862489.758070:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388224 00000100:00100000:1.0:1787862489.758073:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388224 00000100:00100000:1.0:1787862489.758090:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862489.758096:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.758134:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526387968:12345-0@lo:400:kworker.0 Request processed in 38us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.758140:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862489.758151:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787862489.758156:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.758182:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526388224:12345-0@lo:400:kworker.0 Request processed in 26us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862489.758188:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787862489.758254:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526387840:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.758267:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526387712:0@lo:400:kworker.0 00010000:00080000:1.0:1787862489.758290:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec7840 x1874709526388224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862489.758301:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526388224:0@lo:400:kworker.0 00010000:00080000:1.0:1787862489.758340:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a640319ad00 x1874709526387968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862489.758349:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526387968:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.758359:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526387584:0@lo:400:kworker.0 00000100:00100000:1.0:1787862489.758380:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526388096:0@lo:400:kworker.0 00000100:00080000:0.0:1787862489.758584:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862489.758590:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862489.758593:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862490.269389:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862490.269423:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526388352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862490.269527:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862490.269664:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388352 00000100:00100000:3.0:1787862490.269675:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388352 00000100:00100000:3.0:1787862490.269746:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787862490.269759:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526388352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862490.269804:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862490.269868:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526388352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862490.269876:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787862490.269924:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3e1c0 x1874709526388352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862490.269947:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526388352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862490.654904:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862490.826195:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862490.826260:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862490.826431:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918784 00000100:00100000:1.0:1787862490.826445:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918784 00000100:00100000:1.0:1787862490.826522:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 200 00000100:00100000:1.0:1787862490.826543:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516918784:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862490.826643:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516918784:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 103us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862490.826652:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 200 00000100:00100000:2.0:1787862490.827101:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516918912 00000100:00100000:2.0:1787862490.827107:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516918912 00000100:00100000:2.0:1787862490.827193:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:2.0:1787862490.827204:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516918912:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862490.827264:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516918912:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 65us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862490.827271:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00080000:0.0:1787862490.827489:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787862491.041596:0:9234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.108 00010000:00010000:3.0:1787862491.677173:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862491.804273:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862491.804311:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526388480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862491.804435:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862491.804699:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388480 00000100:00100000:2.0:1787862491.804709:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388480 00000100:00100000:2.0:1787862491.804793:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862491.804806:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526388480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862491.804855:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862491.804917:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526388480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862491.804925:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787862491.809477:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862491.809578:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e52c0 x1874709526388480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862491.809615:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526388480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862492.700395:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862493.726868:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862494.749136:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862494.877896:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526388992:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878002:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.878108:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787862494.878116:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526388608:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878163:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.878188:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526389120:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878218:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.878257:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526388736:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878283:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.878301:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526389248:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878336:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.878358:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862494.878363:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526388864:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878385:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862494.878419:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388992 00000100:00100000:3.0:1787862494.878429:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388992 00000100:00100000:3.0:1787862494.878494:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389248 00000100:00100000:3.0:1787862494.878497:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389248 00000100:00100000:3.0:1787862494.878519:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862494.878529:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878592:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526388992:12345-0@lo:400:kworker.0 Request processed in 63us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862494.878600:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862494.878619:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862494.878625:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878654:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526389248:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862494.878660:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787862494.878677:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388608 00000100:00100000:3.0:1787862494.878681:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388608 00000100:00100000:3.0:1787862494.878717:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787862494.878723:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.878755:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526388608:12345-0@lo:400:kworker.0 Request processed in 33us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862494.878762:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1787862494.878793:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862494.878798:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862494.878843:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526388608:0@lo:400:kworker.0 00010000:00080000:3.0:1787862494.878860:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3cf00 x1874709526388992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862494.878873:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526388992:0@lo:400:kworker.0 00010000:00080000:3.0:1787862494.878906:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3cb40 x1874709526389248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862494.878914:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526389248:0@lo:400:kworker.0 00000100:00100000:1.0:1787862494.886148:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389120 00000100:00100000:1.0:1787862494.886170:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389120 00000100:00100000:1.0:1787862494.886248:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388736 00000100:00100000:1.0:1787862494.886252:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388736 00000100:00100000:1.0:1787862494.886267:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526388864 00000100:00100000:1.0:1787862494.886270:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526388864 00000100:00100000:1.0:1787862494.886293:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787862494.886305:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526389120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862494.886447:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526389120:12345-0@lo:400:kworker.0 Request processed in 144us (8227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862494.886473:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787862494.886493:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787862494.886500:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862494.886538:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526388736:12345-0@lo:400:kworker.0 Request processed in 39us (8254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862494.886544:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787862494.886556:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787862494.886562:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862494.886589:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526388864:12345-0@lo:400:kworker.0 Request processed in 28us (8203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862494.886596:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787862494.886932:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862494.887003:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526389120:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.887074:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526388864:0@lo:400:kworker.0 00000100:00100000:3.0:1787862494.887088:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526388736:0@lo:400:kworker.0 00000001:02000400:2.0:1787862495.061641:0:9331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.108 00000100:00100000:3.0:1787862495.390589:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862495.390620:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526389376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862495.390734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862495.395292:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389376 00000100:00100000:1.0:1787862495.395326:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389376 00000100:00100000:1.0:1787862495.406090:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862495.406108:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526389376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862495.406172:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862495.406498:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526389376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 394us (15765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862495.406506:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787862495.422867:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3de00 x1874709526389376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862495.422901:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526389376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862495.774464:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862495.947975:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862495.948037:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862495.948213:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919168 00000100:00100000:2.0:1787862495.948223:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919168 00000100:00100000:2.0:1787862495.948332:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:2.0:1787862495.948344:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516919168:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862495.948418:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516919168:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862495.948426:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:1.0:1787862495.948771:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919040 00000100:00100000:1.0:1787862495.948776:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919040 00000100:00100000:1.0:1787862495.948815:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 202 00000100:00100000:1.0:1787862495.948823:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516919040:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862495.948867:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709516919040:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 45us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862495.948883:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 202 00000100:00080000:3.0:1787862495.949581:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862496.799330:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862496.927017:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862496.927117:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862496.930855:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389504 00000100:00100000:2.0:1787862496.930876:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389504 00000100:00100000:2.0:1787862496.930974:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862496.930987:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862496.931031:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862496.931171:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862496.931178:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787862496.931348:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e6940 x1874709526389504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862496.931369:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526389504:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862496.933089:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862497.820367:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862498.135230:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.108 00010000:00010000:2.0:1787862498.844896:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862499.868366:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862499.998203:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526390016:0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.998663:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862499.998729:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862499.998736:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526389632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.998767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862499.998788:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526390144:0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.998842:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862499.998870:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526389760:0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.998892:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862499.998907:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526390272:0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.998924:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862499.998937:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862499.998942:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526389888:0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.998959:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862499.998989:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390016 00000100:00100000:2.0:1787862499.998996:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390016 00000100:00100000:2.0:1787862499.999066:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390272 00000100:00100000:2.0:1787862499.999082:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390272 00000100:00100000:2.0:1787862499.999102:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862499.999110:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526390016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.999159:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526390016:12345-0@lo:400:kworker.0 Request processed in 50us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862499.999166:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862499.999181:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862499.999186:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862499.999209:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526390272:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862499.999215:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862499.999230:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389632 00000100:00100000:2.0:1787862499.999233:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389632 00000100:00100000:2.0:1787862499.999255:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787862499.999261:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526389632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.001975:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526389632:12345-0@lo:400:kworker.0 Request processed in 2704us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862500.001991:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787862500.002072:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390144 00000100:00100000:2.0:1787862500.002080:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390144 00000100:00100000:2.0:1787862500.002126:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389760 00000100:00100000:2.0:1787862500.002131:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389760 00000100:00100000:2.0:1787862500.002146:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526389888 00000100:00100000:2.0:1787862500.002149:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526389888 00000100:00100000:2.0:1787862500.002166:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862500.002175:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526390144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.002225:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526390144:12345-0@lo:400:kworker.0 Request processed in 51us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862500.002239:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862500.002252:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862500.002258:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526389760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.004581:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526389760:12345-0@lo:400:kworker.0 Request processed in 2312us (5676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862500.004596:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862500.004759:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862500.004773:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526389888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.004825:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526389888:12345-0@lo:400:kworker.0 Request processed in 59us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862500.004831:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787862500.004873:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862500.004879:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862500.004882:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862500.004931:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526389888:0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.004943:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526389760:0@lo:400:kworker.0 00010000:00080000:2.0:1787862500.004958:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e5a40 x1874709526390272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862500.004969:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526390272:0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.005003:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526389632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862500.005015:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526390144:0@lo:400:kworker.0 00010000:00080000:2.0:1787862500.005027:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e6580 x1874709526390016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862500.005074:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526390016:0@lo:400:kworker.0 00000001:02000400:3.0:1787862500.138065:0:9478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 16:28:18 EDT 2026 00000100:00100000:1.0:1787862500.509544:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862500.509570:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862500.509659:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862500.509734:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390400 00000100:00100000:1.0:1787862500.509742:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390400 00000100:00100000:1.0:1787862500.509789:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862500.509799:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526390400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862500.509836:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862500.509879:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526390400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862500.509886:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787862500.509921:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e34b40 x1874709526390400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862500.509939:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526390400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862500.897108:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862501.067237:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862501.067312:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862501.067524:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919296 00000100:00100000:0.0:1787862501.067550:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919296 00000100:00100000:0.0:1787862501.067622:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 204 00000100:00100000:0.0:1787862501.067634:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2349:x1874709516919296:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862501.067735:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2349:x1874709516919296:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 104us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862501.067753:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 204 00000100:00100000:2.0:1787862501.068779:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919424 00000100:00100000:2.0:1787862501.068789:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919424 00000100:00100000:2.0:1787862501.068867:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:2.0:1787862501.068877:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516919424:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862501.068936:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516919424:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 62us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862501.068942:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00080000:0.0:1787862501.070316:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862501.920225:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862502.052419:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862502.052446:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526390528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862502.052536:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862502.052711:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390528 00000100:00100000:1.0:1787862502.052722:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390528 00000100:00100000:1.0:1787862502.052806:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787862502.052818:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526390528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862502.052860:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862502.052907:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526390528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862502.052914:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787862502.052979:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862502.053331:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e34b40 x1874709526390528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862502.053355:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526390528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862502.944940:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862503.966642:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862504.989700:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862505.116415:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526391040:0@lo:400:kworker.0 00000100:00100000:0.0:1787862505.116491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862505.116552:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862505.116559:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526390656:0@lo:400:kworker.0 00000100:00100000:0.0:1787862505.116588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862505.116610:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526391168:0@lo:400:kworker.0 00000100:00100000:0.0:1787862505.116685:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862505.117612:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526390912:0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.117660:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862505.117687:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862505.117694:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526390784:0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.117718:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862505.117736:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526391296:0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.117757:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862505.117782:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391040 00000100:00100000:2.0:1787862505.117789:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391040 00000100:00100000:2.0:1787862505.117840:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391296 00000100:00100000:2.0:1787862505.117843:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391296 00000100:00100000:2.0:1787862505.117856:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862505.117862:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.117904:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526391040:12345-0@lo:400:kworker.0 Request processed in 42us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862505.117909:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862505.118081:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862505.118100:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.118140:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526391296:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862505.118147:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862505.118167:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390656 00000100:00100000:2.0:1787862505.118170:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390656 00000100:00100000:2.0:1787862505.118197:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787862505.118205:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526390656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.118249:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526390656:12345-0@lo:400:kworker.0 Request processed in 45us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862505.118255:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787862505.118285:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391168 00000100:00100000:2.0:1787862505.118289:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391168 00000100:00100000:2.0:1787862505.118314:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390912 00000100:00100000:2.0:1787862505.118317:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390912 00000100:00100000:2.0:1787862505.118329:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526390784 00000100:00100000:2.0:1787862505.118331:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526390784 00000100:00100000:2.0:1787862505.118342:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862505.118348:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526391168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.118376:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526391168:12345-0@lo:400:kworker.0 Request processed in 29us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862505.118381:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862505.118390:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862505.118393:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526390912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.118411:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526390912:12345-0@lo:400:kworker.0 Request processed in 18us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862505.118414:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862505.118427:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862505.118431:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.118456:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526390784:12345-0@lo:400:kworker.0 Request processed in 24us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862505.118462:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787862505.118485:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862505.118490:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862505.118492:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862505.118716:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526390656:0@lo:400:kworker.0 00000100:00100000:2.0:1787862505.118727:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526391168:0@lo:400:kworker.0 00010000:00080000:2.0:1787862505.118737:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa44f00 x1874709526391040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862505.118747:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526391040:0@lo:400:kworker.0 00000100:00100000:0.0:1787862505.118848:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526390784:0@lo:400:kworker.0 00010000:00080000:0.0:1787862505.118861:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa45a40 x1874709526391296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862505.118870:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526391296:0@lo:400:kworker.0 00000100:00100000:0.0:1787862505.118880:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526390912:0@lo:400:kworker.0 00000100:00100000:1.0:1787862505.629169:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862505.629229:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526391424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862505.629310:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862505.629760:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391424 00000100:00100000:0.0:1787862505.629768:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391424 00000100:00100000:0.0:1787862505.629834:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862505.629845:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526391424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862505.629888:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862505.629951:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526391424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862505.629959:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787862505.630735:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3de00 x1874709526391424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862505.630759:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526391424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862506.012286:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862506.188934:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862506.188992:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862506.189025:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919552 00000100:00100000:2.0:1787862506.189061:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919552 00000100:00100000:2.0:1787862506.189116:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 206 00000100:00100000:2.0:1787862506.189126:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2349:x1874709516919552:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862506.189197:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2349:x1874709516919552:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862506.189204:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 206 00000100:00100000:3.0:1787862506.190367:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919680 00000100:00100000:3.0:1787862506.190377:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919680 00000100:00100000:3.0:1787862506.190464:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1787862506.190473:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516919680:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862506.190531:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516919680:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 60us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862506.190537:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00080000:2.0:1787862506.190710:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787862507.056112:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862507.174449:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526391552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862507.174529:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862507.178340:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391552 00000100:00100000:1.0:1787862507.178359:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391552 00000100:00100000:1.0:1787862507.178463:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862507.178475:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526391552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862507.178520:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787862507.179978:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862507.187378:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526391552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8895us (12838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862507.187395:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787862507.188320:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e36940 x1874709526391552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862507.188354:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526391552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862508.074346:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862509.086496:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862510.108562:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862510.240707:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526392064:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.240796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862510.240872:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862510.240879:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526391680:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.240908:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862510.240934:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526392192:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.240961:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862510.240987:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526391936:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241009:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862510.241029:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862510.241034:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526391808:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241087:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862510.241106:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526392320:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241128:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862510.241156:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392064 00000100:00100000:2.0:1787862510.241163:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392064 00000100:00100000:2.0:1787862510.241335:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392320 00000100:00100000:2.0:1787862510.241340:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392320 00000100:00100000:2.0:1787862510.241358:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787862510.241368:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526392064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241425:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526392064:12345-0@lo:400:kworker.0 Request processed in 58us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862510.241449:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787862510.241466:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787862510.241472:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526392320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241506:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526392320:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862510.241512:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787862510.241531:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391680 00000100:00100000:2.0:1787862510.241534:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391680 00000100:00100000:2.0:1787862510.241559:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787862510.241565:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526391680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241594:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526391680:12345-0@lo:400:kworker.0 Request processed in 29us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862510.241600:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787862510.241625:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392192 00000100:00100000:2.0:1787862510.241628:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392192 00000100:00100000:2.0:1787862510.241653:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391936 00000100:00100000:2.0:1787862510.241656:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391936 00000100:00100000:2.0:1787862510.241668:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526391808 00000100:00100000:2.0:1787862510.241670:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526391808 00000100:00100000:2.0:1787862510.241683:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862510.241690:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526392192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241720:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526392192:12345-0@lo:400:kworker.0 Request processed in 31us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862510.241726:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862510.241738:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862510.241744:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526391936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.241782:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526391936:12345-0@lo:400:kworker.0 Request processed in 39us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862510.241788:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862510.241800:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787862510.243378:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526391808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.243460:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526391808:12345-0@lo:400:kworker.0 Request processed in 1655us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862510.243469:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787862510.243515:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862510.243521:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862510.243524:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862510.243573:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526391808:0@lo:400:kworker.0 00010000:00080000:2.0:1787862510.243590:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e08000 x1874709526392320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862510.243600:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526392320:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.246036:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526391936:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.246149:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526391680:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.246167:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526392192:0@lo:400:kworker.0 00010000:00080000:2.0:1787862510.246193:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e092c0 x1874709526392064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862510.246204:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526392064:0@lo:400:kworker.0 00000100:00100000:2.0:1787862510.761381:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862510.761474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862510.761676:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392448 00000100:00100000:1.0:1787862510.761685:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392448 00000100:00100000:1.0:1787862510.761751:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787862510.761762:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526392448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862510.761806:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862510.761862:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526392448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (387us total) trans 0 rc 0/0 00010000:00080000:2.0:1787862510.761905:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401b3cf00 x1874709526392448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862510.761925:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862510.762065:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787862511.133556:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862511.310676:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862511.310721:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862511.310793:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919936 00000100:00100000:1.0:1787862511.310803:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919936 00000100:00100000:1.0:1787862511.310884:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:1.0:1787862511.310895:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516919936:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862511.310984:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516919936:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862511.310993:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00080000:3.0:1787862511.311447:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862511.311526:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516919808 00000100:00100000:2.0:1787862511.311531:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516919808 00000100:00100000:2.0:1787862511.311601:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 208 00000100:00100000:2.0:1787862511.311619:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516919808:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862511.311657:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516919808:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 49us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862511.311665:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 208 00010000:00010000:3.0:1787862512.156428:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862512.289354:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526392576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862512.289504:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862512.291102:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392576 00000100:00100000:1.0:1787862512.291119:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392576 00000100:00100000:1.0:1787862512.291223:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862512.291236:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526392576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862512.291292:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862512.291583:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526392576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 350us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862512.291603:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787862512.291630:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862512.292660:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e352c0 x1874709526392576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862512.292694:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526392576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862513.181252:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862514.204535:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862515.230275:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862515.356830:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526392832:0@lo:400:kworker.0 00000100:00100000:1.0:1787862515.356843:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526392704:0@lo:400:kworker.0 00000100:00100000:2.0:1787862515.356911:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526393088:0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.358173:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862515.358998:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526392960:0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.359061:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862515.359136:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392832 00000100:00100000:3.0:1787862515.359144:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392832 00000100:00100000:3.0:1787862515.359340:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392960 00000100:00100000:3.0:1787862515.359345:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392960 00000100:00100000:3.0:1787862515.359380:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787862515.359389:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526392832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.359435:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526392832:12345-0@lo:400:kworker.0 Request processed in 47us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862515.359441:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787862515.359455:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862515.359461:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526392960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.359488:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526392960:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862515.359494:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862515.359541:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526392960:0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.360075:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526392832:0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.360085:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526393344:0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.360119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862515.360458:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393344 00000100:00100000:3.0:1787862515.360464:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393344 00000100:00100000:3.0:1787862515.360496:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787862515.360511:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526393344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862515.360550:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526393344:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862515.360557:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787862515.360599:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bde00 x1874709526393344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862515.360611:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526393344:0@lo:400:kworker.0 00000100:00080000:3.0:1787862515.360675:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862515.360680:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862515.366186:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862515.366276:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526392704 00000100:00100000:1.0:1787862515.366286:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526392704 00000100:00100000:1.0:1787862515.366343:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787862515.366354:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526392704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862515.366430:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526392704:12345-0@lo:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862515.366438:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787862515.366540:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526392704:0@lo:400:kworker.0 00000100:00100000:1.0:1787862515.366556:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526393216:0@lo:400:kworker.0 00000100:00100000:1.0:1787862515.366594:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862515.367761:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393216 00000100:00100000:1.0:1787862515.367772:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393216 00000100:00100000:1.0:1787862515.367830:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862515.367839:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862515.367905:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526393216:12345-0@lo:400:kworker.0 Request processed in 67us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862515.367913:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787862515.367936:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862515.367963:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526393216:0@lo:400:kworker.0 00000100:00100000:2.0:1787862515.371491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862515.371549:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393088 00000100:00100000:2.0:1787862515.371559:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393088 00000100:00100000:2.0:1787862515.371637:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787862515.371650:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526393088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862515.371706:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526393088:12345-0@lo:400:kworker.0 Request processed in 60us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862515.371723:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787862515.372018:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862515.372467:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bda40 x1874709526393088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862515.372483:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526393088:0@lo:400:kworker.0 00000100:00100000:2.0:1787862515.870017:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862515.875634:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862515.875715:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862515.876022:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393472 00000100:00100000:0.0:1787862515.876030:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393472 00000100:00100000:0.0:1787862515.876337:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787862515.876348:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526393472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862515.876386:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862515.876444:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526393472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862515.876450:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787862515.876515:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bde00 x1874709526393472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862515.876533:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526393472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862516.261322:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862516.428392:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862516.428446:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862516.428564:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920192 00000100:00100000:0.0:1787862516.428575:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920192 00000100:00100000:0.0:1787862516.428669:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:0.0:1787862516.428683:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516920192:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862516.428777:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516920192:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862516.428785:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00080000:1.0:1787862516.429291:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862516.429670:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920064 00000100:00100000:2.0:1787862516.429678:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920064 00000100:00100000:2.0:1787862516.429722:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 210 00000100:00100000:2.0:1787862516.429730:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516920064:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862516.429781:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709516920064:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 52us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862516.429787:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 210 00010000:00010000:3.0:1787862517.276752:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862517.406833:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526393600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862517.406912:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862517.407081:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393600 00000100:00100000:1.0:1787862517.407089:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393600 00000100:00100000:1.0:1787862517.407189:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787862517.407208:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526393600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862517.407244:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862517.407306:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526393600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862517.407313:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787862517.407355:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e36d00 x1874709526393600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862517.407374:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526393600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862517.407959:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862518.307096:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862518.719553:0:10108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:28:37 (1787862517) === 00010000:00010000:2.0:1787862519.324282:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862519.562661:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.562766:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920320 00000100:00100000:2.0:1787862519.562788:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920320 00000100:00100000:2.0:1787862519.562885:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:2.0:1787862519.562901:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:8117:x1874709516920320:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862519.562933:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862519.562951:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfde00/0x9c5536ccf892fd35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b345e5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.562981:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfde00/0x9c5536ccf892fd35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345e5 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.562994:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfde00/0x9c5536ccf892fd35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345e5 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.563003:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfde00, rc 0) 00000100:00100000:2.0:1787862519.563129:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8117:x1874709516920320:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 234us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.563137:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:1.0:1787862519.568189:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.568307:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920448 00000100:00100000:2.0:1787862519.568320:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920448 00000100:00100000:2.0:1787862519.568509:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 212 00000100:00100000:2.0:1787862519.568531:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8117:x1874709516920448:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787862519.569565:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8117:x1874709516920448:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 1033us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.569581:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 212 00000100:00100000:0.0:1787862519.573298:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.573405:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920576 00000100:00100000:3.0:1787862519.573416:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920576 00000100:00100000:3.0:1787862519.573470:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:3.0:1787862519.573481:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8117:x1874709516920576:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787862519.573728:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8117:x1874709516920576:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 248us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.573736:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:3.0:1787862519.587686:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862519.587933:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920704 00000100:00100000:1.0:1787862519.587944:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920704 00000100:00100000:1.0:1787862519.588006:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 214 00000100:00100000:1.0:1787862519.588017:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8119:x1874709516920704:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862519.588375:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8119:x1874709516920704:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 357us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862519.588385:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 214 00000100:00100000:1.0:1787862519.621469:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.622004:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920832 00000100:00100000:2.0:1787862519.622015:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920832 00000100:00100000:2.0:1787862519.622135:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:2.0:1787862519.622147:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8119:x1874709516920832:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862519.622468:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8119:x1874709516920832:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 323us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.622484:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:0.0:1787862519.636442:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.636707:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516920960 00000100:00100000:3.0:1787862519.636722:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516920960 00000100:00100000:3.0:1787862519.636863:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 216 00000100:00100000:3.0:1787862519.636876:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:8117:x1874709516920960:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787862519.636902:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862519.636927:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501685000/0x9c5536ccf892fd3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b3460f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.636963:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501685000/0x9c5536ccf892fd3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3460f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.636976:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501685000/0x9c5536ccf892fd3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3460f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862519.636987:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501685000, rc 0) 00000100:00100000:3.0:1787862519.637116:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:8117:x1874709516920960:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 243us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.637124:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 216 00000100:00100000:3.0:1787862519.641958:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862519.643483:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921088 00000100:00100000:1.0:1787862519.643507:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921088 00000100:00100000:1.0:1787862519.643609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:1.0:1787862519.643620:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:8117:x1874709516921088:12345-192.168.202.60@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787862519.643660:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787862519.643770:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787862519.643777:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787862519.643780:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787862519.643854:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787862519.649572:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:8117:x1874709516921088:12345-192.168.202.60@tcp:256:mount.lustre.0 Request processed in 5936us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.649594:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:0.0:1787862519.654451:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.654582:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921216 00000100:00100000:2.0:1787862519.654595:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921216 00000100:00100000:2.0:1787862519.654708:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 218 00000100:00100000:2.0:1787862519.654721:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:8117:x1874709516921216:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862519.654744:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862519.654770:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34616 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.654991:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.655008:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862519.655020:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:2.0:1787862519.655152:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8117:x1874709516921216:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 433us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.655161:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 218 00000100:00100000:3.0:1787862519.657831:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.658080:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921344 00000100:00100000:2.0:1787862519.658106:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921344 00000100:00100000:2.0:1787862519.658183:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 219 00000100:00100000:2.0:1787862519.658195:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8117:x1874709516921344:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787862519.658595:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8117:x1874709516921344:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 402us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.658603:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 219 00000100:00100000:1.0:1787862519.663487:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.664566:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921472 00000100:00100000:2.0:1787862519.664585:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921472 00000100:00100000:2.0:1787862519.664675:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 220 00000100:00100000:2.0:1787862519.664697:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8117:x1874709516921472:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787862519.665094:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8117:x1874709516921472:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 398us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.665105:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 220 00000100:00100000:0.0:1787862519.671273:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.671546:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921600 00000100:00100000:3.0:1787862519.671560:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921600 00000100:00100000:3.0:1787862519.671641:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 221 00000100:00100000:3.0:1787862519.671654:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8124:x1874709516921600:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862519.672506:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8124:x1874709516921600:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 849us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.672520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 221 00000100:00100000:0.0:1787862519.682185:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.682372:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921728 00000100:00100000:3.0:1787862519.682388:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921728 00000100:00100000:3.0:1787862519.682470:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 222 00000100:00100000:3.0:1787862519.682484:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8124:x1874709516921728:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862519.682857:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:8124:x1874709516921728:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 375us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.682866:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 222 00000100:00100000:1.0:1787862519.698875:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862519.698955:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.699113:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921856 00000100:00100000:3.0:1787862519.699127:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921856 00000100:00100000:3.0:1787862519.699173:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922240 00000100:00100000:3.0:1787862519.699176:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922240 00000100:00100000:3.0:1787862519.699244:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:3.0:1787862519.699259:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516922240:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862519.699364:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516922240:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 109us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.699373:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:3.0:1787862519.699395:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862519.699400:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1874709516921856:12345-192.168.202.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787862519.699432:0:5817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 09001ba1-03f5-4db1-a589-c226f7e46380@192.168.202.60@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1787862519.699504:0:5817:0:(genops.c:1385:class_connect()) connect: client 09001ba1-03f5-4db1-a589-c226f7e46380, cookie 0x9c5536ccf892fd4a 00000004:00100000:3.0:1787862519.699561:0:5817:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787862519.700196:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9a6537ecd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862519.700246:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+6:2345:x1874709516921856:12345-192.168.202.60@tcp:38:mount.lustre.0 Request processed in 845us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.700255:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00080000:1.0:1787862519.700665:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862519.707643:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862519.707786:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862519.708082:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516921984 00000100:00100000:1.0:1787862519.708104:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516921984 00000100:00100000:1.0:1787862519.708177:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922112 00000100:00100000:1.0:1787862519.708179:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922112 00000100:00100000:1.0:1787862519.708202:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1787862519.708211:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+7:0:x1874709516921984:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787862519.708263:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862519.708527:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+7:0:x1874709516921984:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 307us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862519.708540:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1787862519.708579:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:1.0:1787862519.708589:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+6:8117:x1874709516922112:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787862519.708616:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862519.708657:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+6:8117:x1874709516922112:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 71us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862519.708663:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00080000:0.0:1787862519.712182:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862519.712219:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.717125:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922368 00000100:00100000:3.0:1787862519.717147:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922368 00000100:00100000:3.0:1787862519.717257:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:3.0:1787862519.717270:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+6:8117:x1874709516922368:12345-192.168.202.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787862519.717398:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+6:8117:x1874709516922368:12345-192.168.202.60@tcp:40:mount.lustre.0 Request processed in 130us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.717407:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862519.720926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862519.725880:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922752 00000100:00100000:3.0:1787862519.725898:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922752 00000100:00100000:3.0:1787862519.726095:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787862519.726106:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09001ba1-03f5-4db1-a589-c226f7e46380+6:8117:x1874709516922752:12345-192.168.202.60@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787862519.726490:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787862519.726648:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:09001ba1-03f5-4db1-a589-c226f7e46380+6:8117:x1874709516922752:12345-192.168.202.60@tcp:33:mount.lustre.0 Request processed in 542us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862519.726656:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1787862519.727285:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862519.731012:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862519.731260:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922496 00000100:00100000:2.0:1787862519.731278:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922496 00000100:00100000:2.0:1787862519.731377:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922624 00000100:00100000:2.0:1787862519.731381:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922624 00000100:00100000:2.0:1787862519.737824:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787862519.737843:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709516922496:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787862519.737892:0:6670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 09001ba1-03f5-4db1-a589-c226f7e46380@192.168.202.60@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1787862519.737940:0:6670:0:(genops.c:1385:class_connect()) connect: client 09001ba1-03f5-4db1-a589-c226f7e46380, cookie 0x9c5536ccf892fd51 00002000:00100000:2.0:1787862519.737957:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 09001ba1-03f5-4db1-a589-c226f7e46380/ffff9a651c227800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787862519.737989:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787862519.742675:0:6670:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787862519.742736:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a651c225000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862519.742831:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09001ba1-03f5-4db1-a589-c226f7e46380+6:2345:x1874709516922496:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 4988us (15555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.742857:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787862519.742900:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787862519.742908:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709516922624:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787862519.742939:0:6670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 09001ba1-03f5-4db1-a589-c226f7e46380@192.168.202.60@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1787862519.742971:0:6670:0:(genops.c:1385:class_connect()) connect: client 09001ba1-03f5-4db1-a589-c226f7e46380, cookie 0x9c5536ccf892fd58 00002000:00100000:2.0:1787862519.742986:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 09001ba1-03f5-4db1-a589-c226f7e46380/ffff9a651c223000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787862519.743023:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787862519.743315:0:6670:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787862519.745609:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a651c225800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862519.745710:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09001ba1-03f5-4db1-a589-c226f7e46380+6:2345:x1874709516922624:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 2798us (14705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862519.745722:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00010000:00010000:0.0:1787862520.348283:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862520.476466:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526393984:0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.476624:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862520.476726:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787862520.476734:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526393856:0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.476764:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862520.476911:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526394112:0@lo:400:kworker.0 00000100:00100000:3.0:1787862520.477658:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526393728:0@lo:400:kworker.0 00000100:00100000:2.0:1787862520.482331:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862520.482707:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393984 00000100:00100000:0.0:1787862520.482721:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393984 00000100:00100000:1.0:1787862520.482905:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394112 00000100:00100000:1.0:1787862520.482911:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394112 00000100:00080000:2.0:1787862520.483039:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862520.483060:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862520.483126:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787862520.483141:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526394112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.483312:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393856 00000100:00100000:0.0:1787862520.483318:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393856 00000100:00100000:0.0:1787862520.483342:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862520.483351:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526393984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.483398:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526393984:12345-0@lo:400:kworker.0 Request processed in 49us (6775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862520.483406:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862520.483425:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862520.483431:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526393856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.483470:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526393856:12345-0@lo:400:kworker.0 Request processed in 39us (6705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862520.483476:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787862520.483902:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526394112:12345-0@lo:400:kworker.0 Request processed in 763us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862520.483910:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787862520.484072:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa44f00 x1874709526394112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862520.484103:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526394112:0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.485667:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526393856:0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.485688:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526394368:0@lo:400:kworker.0 00000100:00100000:3.0:1787862520.486679:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862520.486740:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526394240:0@lo:400:kworker.0 00000100:00100000:2.0:1787862520.486917:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526393728 00000100:00100000:2.0:1787862520.486928:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526393728 00000100:00100000:0.0:1787862520.487058:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862520.487134:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526393984:0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.487191:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394368 00000100:00100000:0.0:1787862520.487196:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394368 00000100:00100000:0.0:1787862520.487261:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862520.487271:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526394368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.487338:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526394368:12345-0@lo:400:kworker.0 Request processed in 68us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862520.487347:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787862520.487654:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862520.487668:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787862520.487678:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526393728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862520.487743:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526393728:12345-0@lo:400:kworker.0 Request processed in 69us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862520.487750:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:0.0:1787862520.492837:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa47480 x1874709526394368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862520.492864:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526394368:0@lo:400:kworker.0 00000100:00100000:3.0:1787862520.496410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862520.496565:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526393728:0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.496839:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394240 00000100:00100000:0.0:1787862520.496850:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394240 00000100:00100000:0.0:1787862520.496943:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862520.496965:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526394240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862520.497125:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526394240:12345-0@lo:400:kworker.0 Request processed in 173us (9169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862520.497134:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787862520.497275:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862520.497314:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526394240:0@lo:400:kworker.0 00000001:00100000:2.0:1787862520.573813:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 09001ba1-03f5-4db1-a589-c226f7e46380 00000100:00100000:3.0:1787862520.998951:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862520.998987:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526394496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862520.999124:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862520.999224:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394496 00000100:00100000:3.0:1787862520.999234:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394496 00000100:00100000:3.0:1787862521.000414:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787862521.000437:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526394496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862521.000473:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862521.000562:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526394496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862521.000571:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787862521.000657:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bc3c0 x1874709526394496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862521.001790:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526394496:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787862521.097121:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 09001ba1-03f5-4db1-a589-c226f7e46380 00010000:00010000:1.0:1787862521.375624:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787862521.585004:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 09001ba1-03f5-4db1-a589-c226f7e46380 00010000:00010000:0.0:1787862522.397506:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862522.531436:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526394624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862522.531545:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862522.531798:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394624 00000100:00100000:1.0:1787862522.531808:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394624 00000100:00100000:1.0:1787862522.531889:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787862522.531902:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526394624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862522.531951:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862522.532007:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526394624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862522.532015:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787862522.532196:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862522.532253:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e34b40 x1874709526394624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862522.532275:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526394624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862523.420363:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862524.452685:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862525.130478:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862525.130558:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862525.130604:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862525.130642:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862525.130706:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862525.130743:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923008 00000100:00100000:1.0:1787862525.130755:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923008 00000100:00100000:1.0:1787862525.130826:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923136 00000100:00100000:1.0:1787862525.130830:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923136 00000100:00100000:1.0:1787862525.130859:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:1.0:1787862525.130870:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516923008:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862525.130974:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516923008:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 106us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.130983:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:1.0:1787862525.131004:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:1.0:1787862525.131011:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516923136:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862525.131089:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516923136:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 79us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.131095:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:1.0:1787862525.131114:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923264 00000100:00100000:1.0:1787862525.131117:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923264 00000100:00100000:1.0:1787862525.131148:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923392 00000100:00100000:1.0:1787862525.131151:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923392 00000100:00100000:1.0:1787862525.131168:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1787862525.131174:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516923264:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862525.131203:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516923264:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.131210:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1787862525.131236:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1787862525.131244:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6540399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516923392:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862525.131299:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6540399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516923392:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 56us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.131306:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:0.0:1787862525.131776:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516922880 00000100:00100000:0.0:1787862525.131792:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516922880 00000100:00100000:0.0:1787862525.131840:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 224 00000100:00100000:0.0:1787862525.131848:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516922880:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862525.131891:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516922880:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 44us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862525.131897:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 224 00000100:00080000:3.0:1787862525.136460:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862525.136475:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862525.136481:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862525.473485:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862525.598986:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526394752:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.599155:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862525.599219:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526395264:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.599251:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862525.599287:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862525.599293:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526395136:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.599324:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862525.599357:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526394880:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.599387:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862525.599407:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526395392:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.599428:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862525.599459:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862525.599465:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526395008:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.599489:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862525.600547:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395264 00000100:00100000:1.0:1787862525.600565:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395264 00000100:00100000:0.0:1787862525.600616:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394752 00000100:00100000:0.0:1787862525.600622:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394752 00000100:00100000:0.0:1787862525.600676:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787862525.600687:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526394752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862525.600735:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526394880 00000100:00100000:1.0:1787862525.600740:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526394880 00000100:00100000:1.0:1787862525.600756:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395008 00000100:00100000:1.0:1787862525.600759:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395008 00000100:00100000:0.0:1787862525.600780:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526394752:12345-0@lo:400:kworker.0 Request processed in 94us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862525.600806:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787862525.600847:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395136 00000100:00100000:0.0:1787862525.600851:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395136 00000100:00080000:2.0:1787862525.601294:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862525.601302:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862525.601411:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862525.601432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526395264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862525.601486:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526395264:12345-0@lo:400:kworker.0 Request processed in 68us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.601493:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862525.601508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862525.601515:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526394880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862525.601558:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526394880:12345-0@lo:400:kworker.0 Request processed in 44us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.601566:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862525.601578:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862525.601583:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526395008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862525.601613:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526395008:12345-0@lo:400:kworker.0 Request processed in 30us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862525.601620:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862525.601645:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395392 00000100:00100000:0.0:1787862525.601650:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395392 00000100:00100000:0.0:1787862525.601670:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787862525.601676:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526395136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.601713:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526395136:12345-0@lo:400:kworker.0 Request processed in 36us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862525.601719:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787862525.601731:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862525.601737:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526395392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.601766:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526395392:12345-0@lo:400:kworker.0 Request processed in 30us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862525.601773:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787862525.601844:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651c17d680 x1874709526395136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862525.601862:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526395136:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.601876:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526394752:0@lo:400:kworker.0 00000100:00100000:0.0:1787862525.601887:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526395264:0@lo:400:kworker.0 00000100:00100000:3.0:1787862525.601936:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526395008:0@lo:400:kworker.0 00000100:00100000:3.0:1787862525.601951:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526394880:0@lo:400:kworker.0 00010000:00080000:3.0:1787862525.601964:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651c17e940 x1874709526395392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862525.601975:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526395392:0@lo:400:kworker.0 00000100:00080000:2.0:1787862525.602927:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1787862526.017766:0:10305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787862526.108748:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526395520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862526.108849:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862526.109456:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395520 00000100:00100000:1.0:1787862526.109467:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395520 00000100:00100000:1.0:1787862526.109534:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787862526.109546:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526395520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862526.109600:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862526.109681:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526395520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862526.109689:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787862526.110367:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bed00 x1874709526395520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862526.110392:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526395520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862526.494094:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862527.517837:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862527.651902:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862527.651935:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526395648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862527.652072:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862527.652315:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395648 00000100:00100000:0.0:1787862527.652325:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395648 00000100:00100000:0.0:1787862527.652408:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787862527.652422:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526395648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862527.652499:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862527.652558:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526395648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862527.652567:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787862527.652729:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862527.652766:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6533e35a40 x1874709526395648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862527.652786:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526395648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862528.540454:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862529.564839:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862530.269102:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862530.269151:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862530.269187:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862530.269206:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862530.269231:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862530.269271:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923520 00000100:00100000:1.0:1787862530.269283:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923520 00000100:00100000:1.0:1787862530.269347:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 226 00000100:00100000:1.0:1787862530.269360:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516923520:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862530.269454:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516923520:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862530.269464:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 226 00000100:00100000:1.0:1787862530.269508:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923648 00000100:00100000:1.0:1787862530.269512:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923648 00000100:00100000:1.0:1787862530.269551:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923776 00000100:00100000:1.0:1787862530.269553:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923776 00000100:00100000:1.0:1787862530.269573:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:1.0:1787862530.269579:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516923648:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862530.269636:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516923648:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 57us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862530.269643:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:1.0:1787862530.269654:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:1.0:1787862530.269660:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516923776:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862530.269693:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516923776:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862530.269699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:1.0:1787862530.269718:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516923904 00000100:00100000:1.0:1787862530.269722:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516923904 00000100:00100000:1.0:1787862530.269750:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924032 00000100:00100000:1.0:1787862530.269752:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924032 00000100:00100000:1.0:1787862530.269766:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:1.0:1787862530.269772:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516923904:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862530.269796:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516923904:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862530.269801:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:1.0:1787862530.269811:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:1.0:1787862530.269816:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516924032:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862530.269835:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516924032:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 20us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862530.269841:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00080000:2.0:1787862530.270110:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862530.270117:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862530.270120:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862530.588336:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862530.716475:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526395904:0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.716495:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526395776:0@lo:400:kworker.0 00000100:00100000:1.0:1787862530.716715:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526396160:0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.717291:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862530.717577:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526396288:0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.717615:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862530.717705:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396288 00000100:00100000:3.0:1787862530.717714:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396288 00000100:00100000:3.0:1787862530.717786:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787862530.717799:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526396288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.717865:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526396288:12345-0@lo:400:kworker.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862530.717873:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787862530.718287:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526396288:0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.720067:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526396032:0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.720161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862530.720221:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396032 00000100:00100000:3.0:1787862530.720230:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396032 00000100:00100000:3.0:1787862530.720289:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862530.720299:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526396032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862530.721268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862530.721406:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396160 00000100:00100000:1.0:1787862530.721413:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396160 00000100:00100000:1.0:1787862530.721458:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787862530.721466:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526396160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862530.721533:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526396160:12345-0@lo:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862530.721541:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787862530.721653:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa47480 x1874709526396160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862530.721670:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526396160:0@lo:400:kworker.0 00000100:00100000:2.0:1787862530.721825:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862530.721857:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526396416:0@lo:400:kworker.0 00000100:00100000:2.0:1787862530.721887:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787862530.721936:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862530.721943:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862530.722790:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526396032:12345-0@lo:400:kworker.0 Request processed in 2486us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862530.722805:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862530.722831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395904 00000100:00100000:3.0:1787862530.722849:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395904 00000100:00100000:3.0:1787862530.722885:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787862530.722892:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526395904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.722929:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526395904:12345-0@lo:400:kworker.0 Request processed in 38us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862530.722935:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787862530.722962:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396416 00000100:00100000:3.0:1787862530.722966:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396416 00000100:00100000:3.0:1787862530.723007:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787862530.723014:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526396416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787862530.723195:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862530.723232:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526395904:0@lo:400:kworker.0 00000100:00100000:2.0:1787862530.724164:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526396032:0@lo:400:kworker.0 00000100:00100000:0.0:1787862530.724783:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526395776 00000100:00100000:0.0:1787862530.724797:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526395776 00000100:00100000:0.0:1787862530.725008:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787862530.725019:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526395776:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787862530.725454:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa47840 x1874709526396416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862530.725470:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526396416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862530.725567:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526395776:12345-0@lo:400:kworker.0 Request processed in 550us (8277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862530.725575:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787862530.725624:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526395776:0@lo:400:kworker.0 00000100:00100000:3.0:1787862530.729573:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526396416:12345-0@lo:400:kworker.0 Request processed in 6542us (7666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862530.729594:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787862531.235119:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526396544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862531.235223:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862531.235330:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396544 00000100:00100000:2.0:1787862531.235341:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396544 00000100:00100000:2.0:1787862531.235403:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787862531.235425:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526396544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862531.235477:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862531.235534:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526396544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862531.235542:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787862531.235605:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bd2c0 x1874709526396544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862531.235629:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526396544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862531.622329:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862532.638979:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862532.768108:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526396672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862532.768220:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862532.768406:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396672 00000100:00100000:0.0:1787862532.768416:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396672 00000100:00100000:0.0:1787862532.768495:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862532.768507:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526396672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862532.768555:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787862532.772540:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862532.780014:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526396672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11490us (11775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862532.780035:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787862532.782135:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa45a40 x1874709526396672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862532.782175:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526396672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862533.661089:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862534.684256:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862535.374329:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862535.379434:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924160 00000100:00100000:1.0:1787862535.379451:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924160 00000100:00100000:1.0:1787862535.379530:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 228 00000100:00100000:1.0:1787862535.379541:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516924160:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862535.379635:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516924160:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 96us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862535.379643:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 228 00000100:00100000:1.0:1787862535.398708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862535.398743:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862535.398773:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862535.398793:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862535.398817:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924544 00000100:00100000:1.0:1787862535.398827:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924544 00000100:00100000:1.0:1787862535.398878:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924672 00000100:00100000:1.0:1787862535.398880:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924672 00000100:00100000:1.0:1787862535.398895:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:1.0:1787862535.398905:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516924544:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862535.398989:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516924544:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862535.398997:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:1.0:1787862535.399016:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:1.0:1787862535.399023:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516924672:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862535.399075:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516924672:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862535.399081:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:3.0:1787862535.400363:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924288 00000100:00100000:3.0:1787862535.400375:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924288 00000100:00100000:3.0:1787862535.400423:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924416 00000100:00100000:3.0:1787862535.400427:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924416 00000100:00100000:3.0:1787862535.400453:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787862535.400461:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516924288:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862535.400515:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516924288:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 55us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.400523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787862535.400537:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:3.0:1787862535.400544:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516924416:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862535.400567:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516924416:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.400581:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00080000:3.0:1787862535.400606:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862535.400611:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862535.400614:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862535.709501:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862535.838999:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526396800:0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.839137:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862535.839876:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526396928:0@lo:400:kworker.0 00000100:00100000:2.0:1787862535.839928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862535.840005:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526397440:0@lo:400:kworker.0 00000100:00100000:2.0:1787862535.840072:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862535.840120:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862535.840140:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526397056:0@lo:400:kworker.0 00000100:00100000:2.0:1787862535.840175:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862535.842288:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526397312:0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842337:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862535.842364:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862535.842371:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526397184:0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842398:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862535.842442:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396928 00000100:00100000:3.0:1787862535.842451:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396928 00000100:00100000:3.0:1787862535.842498:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397056 00000100:00100000:3.0:1787862535.842501:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397056 00000100:00100000:3.0:1787862535.842523:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397312 00000100:00100000:3.0:1787862535.842526:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397312 00000100:00100000:3.0:1787862535.842542:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862535.842550:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526396928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842610:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526396928:12345-0@lo:400:kworker.0 Request processed in 61us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.842617:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862535.842633:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787862535.842639:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526397056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842666:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526397056:12345-0@lo:400:kworker.0 Request processed in 28us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.842682:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787862535.842695:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787862535.842701:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526397312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842732:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526397312:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.842738:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787862535.842761:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397440 00000100:00100000:3.0:1787862535.842765:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397440 00000100:00100000:3.0:1787862535.842791:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397184 00000100:00100000:3.0:1787862535.842794:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397184 00000100:00100000:3.0:1787862535.842807:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787862535.842812:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526397440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842843:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526397440:12345-0@lo:400:kworker.0 Request processed in 31us (2772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.842849:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787862535.842859:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787862535.842864:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526397184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842897:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526397184:12345-0@lo:400:kworker.0 Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862535.842903:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787862535.842919:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862535.842921:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526396800 00000100:00080000:3.0:1787862535.842924:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862535.842925:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526396800 00000100:00080000:3.0:1787862535.842926:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862535.842968:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526397056:0@lo:400:kworker.0 00000100:00100000:0.0:1787862535.842972:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787862535.842979:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526396800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.842980:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526396928:0@lo:400:kworker.0 00010000:00080000:3.0:1787862535.842993:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9be1c0 x1874709526397440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862535.843009:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526397440:0@lo:400:kworker.0 00000100:00100000:0.0:1787862535.843011:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526396800:12345-0@lo:400:kworker.0 Request processed in 34us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862535.843016:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00080000:3.0:1787862535.843071:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bf480 x1874709526397184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862535.843080:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526397184:0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.843089:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526396800:0@lo:400:kworker.0 00000100:00100000:3.0:1787862535.843098:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526397312:0@lo:400:kworker.0 00000100:00100000:1.0:1787862536.348888:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862536.348913:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526397568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862536.348998:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862536.349091:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397568 00000100:00100000:1.0:1787862536.349099:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397568 00000100:00100000:1.0:1787862536.349146:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787862536.349156:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526397568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862536.349195:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862536.349906:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526397568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 749us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862536.349924:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787862536.349944:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651feabc00 x1874709526397568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862536.349964:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526397568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862536.745744:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862537.757288:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862537.884274:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526397696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862537.884372:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862537.884758:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397696 00000100:00100000:1.0:1787862537.884765:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397696 00000100:00100000:1.0:1787862537.884830:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862537.884841:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526397696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862537.884880:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862537.884942:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526397696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862537.884950:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787862537.886690:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787862537.886763:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fea8f00 x1874709526397696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862537.886789:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526397696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862538.780579:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862539.811326:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862540.493695:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862540.493743:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862540.493777:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862540.493802:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862540.493998:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924800 00000100:00100000:0.0:1787862540.494008:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924800 00000100:00100000:0.0:1787862540.494224:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 230 00000100:00100000:0.0:1787862540.494235:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516924800:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862540.494305:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516924800:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 72us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862540.494313:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 230 00000100:00100000:3.0:1787862540.494915:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925184 00000100:00100000:3.0:1787862540.494920:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925184 00000100:00100000:3.0:1787862540.494979:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787862540.495068:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2345:x1874709516925184:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:3.0:1787862540.495090:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fd51 00000100:00080000:3.0:1787862540.495099:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a651c225000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787862540.495135:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787862540.495480:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:09001ba1-03f5-4db1-a589-c226f7e46380+2:2345:x1874709516925184:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 491us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862540.495505:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787862540.495542:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925056 00000100:00100000:3.0:1787862540.495547:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925056 00000100:00100000:3.0:1787862540.495572:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516924928 00000100:00100000:3.0:1787862540.495576:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516924928 00000100:00100000:3.0:1787862540.495607:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:3.0:1787862540.495614:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516925056:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862540.495907:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516925056:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 292us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862540.495914:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:3.0:1787862540.495928:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:3.0:1787862540.495935:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516924928:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862540.495961:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516924928:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862540.495967:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00080000:0.0:1787862540.501634:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862540.501652:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862540.501663:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862540.514494:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862540.515292:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925312 00000100:00100000:3.0:1787862540.515303:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925312 00000100:00100000:3.0:1787862540.515391:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:3.0:1787862540.515404:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2345:x1874709516925312:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:3.0:1787862540.515435:0:6672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fd58 00000100:00080000:3.0:1787862540.515444:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9a651c225800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787862540.515480:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787862540.515865:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09001ba1-03f5-4db1-a589-c226f7e46380+2:2345:x1874709516925312:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 464us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862540.515874:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00080000:1.0:1787862540.517242:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862540.517258:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862540.857549:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862540.963607:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526397824:0@lo:400:kworker.0 00000100:00100000:3.0:1787862540.963683:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862540.963797:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526398208:0@lo:400:kworker.0 00000100:00100000:3.0:1787862540.963826:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862540.963874:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526398336:0@lo:400:kworker.0 00000100:00100000:3.0:1787862540.963913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862540.963944:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398336 00000100:00100000:3.0:1787862540.963950:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398336 00000100:00100000:3.0:1787862540.964006:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787862540.964015:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862540.964087:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526398336:12345-0@lo:400:kworker.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862540.964094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787862540.964150:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526398336:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.969650:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397824 00000100:00100000:0.0:1787862540.969665:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397824 00000100:00100000:0.0:1787862540.969722:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787862540.969732:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526397824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.969829:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526397824:12345-0@lo:400:kworker.0 Request processed in 98us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862540.969851:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787862540.969906:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526397952:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.969944:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862540.969970:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526398464:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.969995:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862540.970019:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862540.970026:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526398080:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.970069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862540.970128:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526397824:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.970155:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398208 00000100:00100000:0.0:1787862540.970159:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398208 00000100:00100000:0.0:1787862540.970187:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398464 00000100:00100000:0.0:1787862540.970189:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398464 00000100:00100000:0.0:1787862540.970205:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787862540.970212:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526398208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.970253:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526398208:12345-0@lo:400:kworker.0 Request processed in 42us (6427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862540.970260:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787862540.970484:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862540.970495:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862540.970538:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526398464:12345-0@lo:400:kworker.0 Request processed in 46us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862540.970544:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787862540.970563:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862540.970566:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862540.970569:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862540.970589:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526397952 00000100:00100000:1.0:1787862540.970593:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526397952 00000100:00100000:1.0:1787862540.970627:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398080 00000100:00100000:1.0:1787862540.970630:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398080 00000100:00100000:1.0:1787862540.970654:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787862540.970660:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862540.970692:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526397952:12345-0@lo:400:kworker.0 Request processed in 33us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862540.970698:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787862540.970710:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787862540.970718:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862540.970744:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526398080:12345-0@lo:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862540.970750:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787862540.970772:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862540.974859:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bc3c0 x1874709526398208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862540.974879:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526398208:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.974936:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526398080:0@lo:400:kworker.0 00000100:00100000:0.0:1787862540.974949:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526397952:0@lo:400:kworker.0 00010000:00080000:0.0:1787862540.974961:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bcb40 x1874709526398464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862540.976706:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526398464:0@lo:400:kworker.0 00000001:00100000:2.0:1787862541.140999:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 09001ba1-03f5-4db1-a589-c226f7e46380 00000020:00000080:2.0:1787862541.141017:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a651c227800/09001ba1-03f5-4db1-a589-c226f7e46380 00000020:00000080:1.0:1787862541.145081:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c227800/09001ba1-03f5-4db1-a589-c226f7e46380 for lustre-OST0000 00000020:00000080:1.0:1787862541.145136:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c225000 for lustre-OST0000 00000100:00100000:0.0:1787862541.468708:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526398592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862541.468783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862541.468960:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398592 00000100:00100000:2.0:1787862541.468968:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398592 00000100:00100000:2.0:1787862541.469023:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787862541.469036:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526398592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862541.469097:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862541.469143:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526398592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862541.469151:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787862541.469382:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653aa45e00 x1874709526398592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862541.469399:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526398592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862541.860897:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787862542.173541:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 09001ba1-03f5-4db1-a589-c226f7e46380 00000020:00000080:2.0:1787862542.173551:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a651c223000/09001ba1-03f5-4db1-a589-c226f7e46380 00000020:00000080:2.0:1787862542.173638:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c223000/09001ba1-03f5-4db1-a589-c226f7e46380 for lustre-OST0001 00000020:00000080:2.0:1787862542.173743:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c225800 for lustre-OST0001 00010000:00010000:0.0:1787862542.879411:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862543.004546:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526398720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862543.004647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862543.004855:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398720 00000100:00100000:3.0:1787862543.004863:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398720 00000100:00100000:3.0:1787862543.004941:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787862543.004954:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526398720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862543.005000:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862543.005087:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526398720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862543.005096:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787862543.005141:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bde00 x1874709526398720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862543.005175:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526398720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862543.005820:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862543.904949:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862544.957106:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862545.635557:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862545.635618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862545.635650:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862545.635686:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925440 00000100:00100000:0.0:1787862545.635700:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925440 00000100:00100000:0.0:1787862545.635769:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 232 00000100:00100000:0.0:1787862545.635781:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516925440:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862545.635893:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516925440:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862545.635905:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 232 00000100:00100000:0.0:1787862545.635952:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925568 00000100:00100000:0.0:1787862545.635976:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925568 00000100:00100000:0.0:1787862545.636024:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925696 00000100:00100000:0.0:1787862545.636027:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925696 00000100:00100000:0.0:1787862545.636082:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:0.0:1787862545.636089:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516925568:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862545.636128:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516925568:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 38us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862545.636135:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:0.0:1787862545.636148:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:0.0:1787862545.636154:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516925696:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862545.636178:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516925696:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862545.636186:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00080000:0.0:1787862545.636357:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862546.013349:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862546.081972:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526398848:0@lo:400:kworker.0 00000100:00100000:3.0:1787862546.082084:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862546.082457:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526398976:0@lo:400:kworker.0 00000100:00100000:0.0:1787862546.082499:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862546.082529:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862546.082535:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526399104:0@lo:400:kworker.0 00000100:00100000:0.0:1787862546.082558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862546.082592:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398976 00000100:00100000:0.0:1787862546.082599:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398976 00000100:00100000:0.0:1787862546.082645:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399104 00000100:00100000:0.0:1787862546.082649:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399104 00000100:00100000:0.0:1787862546.082680:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862546.082688:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862546.082738:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526398976:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862546.082754:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862546.082773:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787862546.082778:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526399104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862546.082807:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526399104:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862546.082814:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787862546.082836:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862546.082879:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526399104:0@lo:400:kworker.0 00000100:00100000:0.0:1787862546.082889:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526398976:0@lo:400:kworker.0 00000100:00100000:1.0:1787862546.082952:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526398848 00000100:00100000:1.0:1787862546.082957:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526398848 00000100:00100000:1.0:1787862546.082989:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787862546.082996:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526398848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862546.084719:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526398848:12345-0@lo:400:kworker.0 Request processed in 1717us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862546.084732:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787862546.085127:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526399488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862546.085176:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862546.085214:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399488 00000100:00100000:1.0:1787862546.085219:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399488 00000100:00100000:1.0:1787862546.085264:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862546.085272:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526399488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862546.085317:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526399488:12345-0@lo:400:kworker.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862546.085324:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787862546.085356:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d5fad00 x1874709526399488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862546.085374:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526399488:0@lo:400:kworker.0 00000100:00080000:0.0:1787862546.086351:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862546.086863:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526398848:0@lo:400:kworker.0 00000100:00100000:3.0:1787862546.086890:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526399360:0@lo:400:kworker.0 00000100:00100000:3.0:1787862546.086937:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862546.087005:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862546.087013:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526399232:0@lo:400:kworker.0 00000100:00100000:3.0:1787862546.087065:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862546.087150:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399232 00000100:00100000:1.0:1787862546.087155:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399232 00000100:00100000:1.0:1787862546.087208:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787862546.087217:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526399232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862546.087260:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526399232:12345-0@lo:400:kworker.0 Request processed in 45us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862546.087267:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787862546.087331:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d5f9a40 x1874709526399232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862546.087342:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526399232:0@lo:400:kworker.0 00000100:00080000:2.0:1787862546.087396:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862546.087443:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399360 00000100:00100000:0.0:1787862546.087448:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399360 00000100:00100000:0.0:1787862546.087524:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787862546.087532:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526399360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862546.087585:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526399360:12345-0@lo:400:kworker.0 Request processed in 55us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862546.087592:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787862546.087699:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526399360:0@lo:400:kworker.0 00000100:00080000:2.0:1787862546.087758:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862546.598736:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862546.598768:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862546.598860:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862546.598938:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399616 00000100:00100000:2.0:1787862546.598946:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399616 00000100:00100000:2.0:1787862546.598998:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787862546.599008:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526399616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862546.599089:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862546.599140:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526399616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862546.599148:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787862546.599190:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d5fa580 x1874709526399616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862546.599209:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526399616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862547.039211:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862548.060272:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862548.124654:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862548.124678:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526399744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862548.124754:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862548.124899:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399744 00000100:00100000:2.0:1787862548.124907:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399744 00000100:00100000:2.0:1787862548.124971:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862548.124983:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526399744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862548.125019:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862548.125099:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526399744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862548.125106:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787862548.125240:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653d9bcb40 x1874709526399744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862548.125258:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526399744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862548.125426:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862549.084240:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862550.083924:0:11011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787862550.109263:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862550.749735:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862550.749768:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862550.749805:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862550.749831:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926080 00000100:00100000:2.0:1787862550.749841:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926080 00000100:00100000:0.0:1787862550.749849:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925952 00000100:00100000:0.0:1787862550.749852:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925952 00000100:00100000:2.0:1787862550.749912:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:3.0:1787862550.749935:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516925824 00000100:00100000:3.0:1787862550.749940:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516925824 00000100:00100000:3.0:1787862550.749970:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 234 00000100:00100000:3.0:1787862550.749977:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516925824:12345-192.168.202.60@tcp:400:kworker.0 00000100:00080000:1.0:1787862550.749986:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862550.750071:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516925824:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862550.750079:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 234 00000100:00100000:0.0:1787862550.759199:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:0.0:1787862550.759217:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516925952:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862550.759301:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516925952:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 89us (9505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862550.759323:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:2.0:1787862550.769007:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2346:x1874709516926080:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862550.769134:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2346:x1874709516926080:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 19211us (19363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862550.769147:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 97 00010000:00010000:0.0:1787862551.135523:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862551.196410:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526400000:0@lo:400:kworker.0 00000100:00100000:3.0:1787862551.196486:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862551.196563:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526400512:0@lo:400:kworker.0 00000100:00100000:3.0:1787862551.196599:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862551.196829:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400000 00000100:00100000:2.0:1787862551.196837:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400000 00000100:00100000:2.0:1787862551.196885:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787862551.196894:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862551.196945:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526400000:12345-0@lo:400:kworker.0 Request processed in 51us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862551.196952:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787862551.196987:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400512 00000100:00100000:2.0:1787862551.196991:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400512 00000100:00100000:2.0:1787862551.197021:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862551.197028:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526400512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862551.197079:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526400512:12345-0@lo:400:kworker.0 Request processed in 52us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862551.197086:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787862551.197200:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e87840 x1874709526400512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862551.197216:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526400512:0@lo:400:kworker.0 00000100:00100000:3.0:1787862551.197246:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526400000:0@lo:400:kworker.0 00000100:00100000:3.0:1787862551.197261:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862551.197267:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526400128:0@lo:400:kworker.0 00000100:00100000:3.0:1787862551.197292:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862551.197652:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526399872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.197688:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862551.197721:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526400384:0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.197743:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862551.197763:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862551.197769:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526400256:0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.197800:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862551.197828:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400256 00000100:00100000:1.0:1787862551.197831:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400256 00000100:00100000:1.0:1787862551.197861:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787862551.197868:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526400256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.197905:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526400256:12345-0@lo:400:kworker.0 Request processed in 37us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862551.197911:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787862551.197935:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526399872 00000100:00100000:1.0:1787862551.197939:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526399872 00000100:00100000:1.0:1787862551.197959:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787862551.197965:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526399872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.197993:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526399872:12345-0@lo:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862551.197999:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:1.0:1787862551.198038:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e870c0 x1874709526400256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862551.198066:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526400256:0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.198076:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526399872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.198097:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400128 00000100:00100000:1.0:1787862551.198101:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400128 00000100:00100000:1.0:1787862551.198124:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400384 00000100:00100000:1.0:1787862551.198134:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400384 00000100:00100000:1.0:1787862551.198158:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787862551.198164:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.198198:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526400128:12345-0@lo:400:kworker.0 Request processed in 34us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862551.198204:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787862551.198214:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787862551.198219:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526400384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862551.198252:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526400384:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862551.198257:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787862551.198283:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526400384:0@lo:400:kworker.0 00000100:00080000:1.0:1787862551.198298:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862551.198304:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862551.198305:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862551.199022:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526400128:0@lo:400:kworker.0 00000100:00100000:0.0:1787862551.708439:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862551.708462:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526400640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862551.708555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862551.708663:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400640 00000100:00100000:2.0:1787862551.708672:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400640 00000100:00100000:2.0:1787862551.708721:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787862551.708731:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526400640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862551.708770:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862551.708833:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526400640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862551.708841:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787862551.722311:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e85680 x1874709526400640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862551.722338:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526400640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862552.158459:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862553.185060:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862553.244617:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862553.244641:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526400768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862553.244710:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862553.244806:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526400768 00000100:00100000:2.0:1787862553.244813:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526400768 00000100:00100000:2.0:1787862553.244866:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787862553.244893:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526400768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862553.244930:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862553.244974:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526400768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862553.244982:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787862553.245005:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862553.245036:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e86940 x1874709526400768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862553.245081:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526400768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862554.209849:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862555.229620:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862555.852019:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862555.852127:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862555.852163:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862555.852203:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926208 00000100:00100000:1.0:1787862555.852216:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926208 00000100:00100000:2.0:1787862555.852344:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926336 00000100:00100000:2.0:1787862555.852349:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926336 00000100:00100000:2.0:1787862555.852401:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926464 00000100:00100000:2.0:1787862555.852405:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926464 00000100:00100000:2.0:1787862555.852445:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:2.0:1787862555.852465:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516926336:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862555.852524:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 236 00000100:00100000:1.0:1787862555.852533:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516926208:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862555.852588:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516926336:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 133us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862555.852588:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516926208:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 56us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862555.852598:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787862555.852598:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 236 00000100:00100000:2.0:1787862555.852618:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:2.0:1787862555.852624:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516926464:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862555.852650:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516926464:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862555.852657:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00080000:2.0:1787862555.852685:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787862555.995616:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd1068ea0 20000000:00000080:2.0:1787862555.995637:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a653465fc00 uarg=0000000000000000 20000000:01000000:2.0:1787862555.995688:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787862555.995695:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787862555.995701:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787862555.997616:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787862555.998448:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787862556.003740:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787862556.005253:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005304:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005314:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005323:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005334:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005343:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005351:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005405:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.005424:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 12 pid: 5808 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.005742:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526400896:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862556.006794:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.006811:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 12 pid: 5810 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.006839:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401024:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862556.006926:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.006934:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 18 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.006942:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401152:0@lo:104: 00000100:00100000:1.0:1787862556.006981:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862556.007071:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.007078:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.007084:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401280:0@lo:104: 00000100:00100000:1.0:1787862556.007099:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862556.012224:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.012243:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 18 pid: 5808 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.012258:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401408:0@lo:104: 00000100:00100000:1.0:1787862556.012327:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862556.015107:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401152 00000100:00100000:3.0:1787862556.018594:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401152 00000100:00100000:1.0:1787862556.019943:0:11160:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862556.020319:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401280 00000100:00100000:3.0:1787862556.020331:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401280 00000100:00100000:3.0:1787862556.020349:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401408 00000100:00100000:3.0:1787862556.020353:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401408 00000100:00100000:3.0:1787862556.020378:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787862556.020390:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:11160:x1874709526401152:12345-0@lo:104: 00010000:00010000:3.0:1787862556.020412:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020541:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862556.020548:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+5:11160:x1874709526401152:12345-0@lo:104: Request processed in 161us (13566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862556.020555:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787862556.020574:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787862556.020580:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:11160:x1874709526401280:12345-0@lo:104: 00010000:00010000:3.0:1787862556.020608:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020652:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787862556.020657:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:11160:x1874709526401280:12345-0@lo:104: Request processed in 78us (13557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862556.020663:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787862556.020681:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862556.020689:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020697:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862556.020702:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020712:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862556.020720:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862556.020725:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862556.020781:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020788:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862556.020814:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020823:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6501685600/0x9c5536ccf892fd20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd27 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.020848:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787862556.020897:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401152:0@lo:104: 00000100:00100000:1.0:1787862556.020911:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401280:0@lo:104: 00010000:00010000:0.0:1787862556.021021:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862556.021061:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862556.021080:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526401536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862556.021148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862556.022777:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.022792:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862556.022797:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.022809:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862556.022817:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862556.022823:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787862556.022865:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401536 00010000:00010000:3.0:1787862556.022874:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.022874:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401536 00010000:00010000:3.0:1787862556.022880:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862556.022902:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.022910:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd19 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.022915:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 19 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.022926:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862556.022928:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862556.022930:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862556.023117:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862556.031027:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862556.031103:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526401664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862556.031767:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862556.039900:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926592 00000100:00100000:1.0:1787862556.039924:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926592 00010000:00010000:1.0:1787862556.039994:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 13 pid: 5808 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.040080:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862556.040092:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526401536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862556.040116:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862556.040189:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 19 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.040205:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 19 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.040230:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501684600/0x9c5536ccf892fd27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fd20 expref: 19 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.040253:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862556.040375:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3281:x1874709526401536:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (19226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862556.040384:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862556.040442:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1787862556.042419:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516926592:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862556.042450:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862556.042477:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 13 pid: 5808 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.042499:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 13 pid: 5808 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.042524:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862556.042602:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516926592:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 202us (19489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862556.043488:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526401536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862556.043543:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926720 00000100:00100000:0.0:1787862556.043550:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926720 00010000:00010000:0.0:1787862556.043580:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 14 pid: 5810 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862556.046125:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787862556.046161:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:11160:x1874709526401408:12345-0@lo:104: 00010000:00010000:3.0:1787862556.046190:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.046337:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862556.046345:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:11160:x1874709526401408:12345-0@lo:104: Request processed in 204us (34017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862556.046353:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787862556.046383:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862556.046390:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.046399:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862556.046404:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.046414:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862556.046423:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862556.046430:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862556.046676:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.046684:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862556.046730:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.046738:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd800/0x9c5536ccf892fd04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd0b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.046856:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862556.046859:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862556.046861:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862556.046872:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862556.046894:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526401792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862556.046949:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862556.047004:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401792 00000100:00100000:3.0:1787862556.047014:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401792 00010000:00010000:3.0:1787862556.047182:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 18 pid: 5808 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862556.047217:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862556.047227:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3283:x1874709526401792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862556.047241:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862556.047247:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 18 pid: 5808 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.047259:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 18 pid: 5808 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.047283:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862556.047315:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3283:x1874709526401792:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862556.047322:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862556.047392:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526401792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862556.048200:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862556.048241:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401664 00000100:00100000:3.0:1787862556.048247:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401664 00010000:00010000:3.0:1787862556.048268:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862556.048292:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862556.048298:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3284:x1874709526401664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862556.048309:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862556.048314:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.048323:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.048338:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fd19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fd12 expref: 18 pid: 5810 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.048351:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862556.048389:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3284:x1874709526401664:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862556.048395:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862556.048429:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526401664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862556.061147:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00010000:00010000:1.0:1787862556.061281:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfc600/0x9c5536ccf892fd43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34616 expref: 13 pid: 5808 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.061305:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526400896:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862556.061317:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401024:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862556.061329:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fd0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fd04 expref: 16 pid: 5808 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862556.061337:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874709526401408:0@lo:104: 00010000:00010000:1.0:1787862556.061379:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862556.068625:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:0.0:1787862556.068659:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:2348:x1874709516926720:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862556.068717:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862556.068730:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 12 pid: 5810 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068764:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 12 pid: 5810 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068792:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501684a00/0x9c5536ccf892fd2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b345de expref: 12 pid: 5810 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068817:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068826:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068849:0:8440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068858:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068867:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068875:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068882:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862556.068887:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.068908:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.069015:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862556.069032:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862556.069169:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2348:x1874709516926720:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 528us (37406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862556.069180:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00010000:00010000:1.0:1787862556.069455:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.069465:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862556.069472:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45000/0x9c5536ccf892fd5f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862556.253242:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862556.320066:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526401920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.320198:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862556.320298:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526401920 00000100:00100000:2.0:1787862556.320307:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526401920 00000100:00100000:2.0:1787862556.322064:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787862556.322091:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3281:x1874709526401920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.322228:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3281:x1874709526401920:12345-0@lo:400:kworker.0 Request processed in 149us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.322236:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787862556.322317:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526401920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.322397:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526402048:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.322459:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862556.322537:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862556.322547:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526402176:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.322574:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862556.322618:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402048 00000100:00100000:2.0:1787862556.322624:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402048 00000100:00100000:2.0:1787862556.322662:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402176 00000100:00100000:2.0:1787862556.322665:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402176 00000100:00100000:2.0:1787862556.322696:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862556.322704:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526402048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.324319:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526402048:12345-0@lo:400:kworker.0 Request processed in 1604us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.324335:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862556.324370:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862556.324386:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526402176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862556.327821:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526402048:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.328270:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526402176:12345-0@lo:400:kworker.0 Request processed in 3889us (5691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.328286:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787862556.328334:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862556.328456:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526402432:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.328530:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862556.331274:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402432 00000100:00100000:2.0:1787862556.331296:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402432 00000100:00100000:2.0:1787862556.331403:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862556.333097:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526402432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862556.333295:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526402304:0@lo:400:kworker.0 00000100:00100000:0.0:1787862556.333404:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862556.333507:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526402176:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.334294:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526402432:12345-0@lo:400:kworker.0 Request processed in 2880us (5762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.334307:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787862556.334350:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862556.334386:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526402432:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.335223:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526402560:0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.335284:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862556.335345:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402304 00000100:00100000:2.0:1787862556.335354:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402304 00000100:00100000:2.0:1787862556.339187:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402560 00000100:00100000:2.0:1787862556.339214:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402560 00000100:00100000:2.0:1787862556.339317:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862556.339330:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526402304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.339486:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526402304:12345-0@lo:400:kworker.0 Request processed in 159us (6081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.339495:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862556.339516:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862556.339523:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526402560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862556.342789:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526402560:12345-0@lo:400:kworker.0 Request processed in 36us (4275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.342819:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787862556.343101:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862556.343727:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862556.343809:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e87480 x1874709526402560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862556.343829:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526402560:0@lo:400:kworker.0 00010000:00080000:2.0:1787862556.345999:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e85a40 x1874709526402304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862556.346024:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526402304:0@lo:400:kworker.0 00000100:00100000:0.0:1787862556.829101:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862556.829140:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526402688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862556.829267:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862556.829536:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402688 00000100:00100000:2.0:1787862556.829548:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402688 00000100:00100000:2.0:1787862556.829615:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787862556.829628:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526402688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862556.829676:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862556.829762:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526402688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862556.829798:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787862556.829869:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e85a40 x1874709526402688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862556.829892:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526402688:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862557.281004:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862557.516326:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862557.516460:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926848 00000100:00100000:0.0:1787862557.516486:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926848 00000100:00100000:0.0:1787862557.516572:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00100000:0.0:1787862557.516585:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:5592:x1874709516926848:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862557.516607:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862557.516637:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34640 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862557.516698:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862557.516711:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862557.516721:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919600, rc 0) 00000100:00100000:0.0:1787862557.516814:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516926848:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 231us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862557.516823:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00100000:2.0:1787862557.527467:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862557.528073:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516926976 00000100:00100000:0.0:1787862557.528090:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516926976 00000100:00100000:0.0:1787862557.528178:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 239 00000100:00100000:0.0:1787862557.528190:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516926976:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862557.528721:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516926976:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 532us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862557.528744:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 239 00000100:00100000:1.0:1787862557.545465:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862557.545650:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927104 00000100:00100000:2.0:1787862557.545663:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927104 00000100:00100000:2.0:1787862557.545748:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 240 00000100:00100000:2.0:1787862557.545761:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516927104:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862557.546138:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516927104:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 379us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862557.546148:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 240 00000100:00100000:2.0:1787862557.561418:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862557.562652:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927232 00000100:00100000:1.0:1787862557.562669:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927232 00000100:00100000:1.0:1787862557.562756:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 241 00000100:00100000:1.0:1787862557.562768:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516927232:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862557.562790:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862557.562813:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34647 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.563675:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.563695:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.563707:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44800, rc 0) 00000100:00100000:1.0:1787862557.563809:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516927232:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 1042us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862557.563818:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 241 00000100:00100000:3.0:1787862557.575967:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862557.576226:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927360 00000100:00100000:0.0:1787862557.576240:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927360 00000100:00100000:0.0:1787862557.576320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 242 00000100:00100000:0.0:1787862557.576332:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516927360:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862557.576756:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516927360:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 423us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862557.576765:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 242 00000100:00100000:2.0:1787862557.585369:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862557.589980:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927488 00000100:00100000:1.0:1787862557.590001:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927488 00000100:00100000:1.0:1787862557.590113:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 243 00000100:00100000:1.0:1787862557.590128:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516927488:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.590452:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516927488:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 328us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862557.590461:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 243 10000000:01000000:3.0:1787862557.852306:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787862557.852315:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a651c992800 from 7 10000000:01000000:3.0:1787862557.852320:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862557.852394:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.852408:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.852423:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862557.852458:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526402816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862557.852575:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862557.852645:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509897b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862557.852721:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402816 00000100:00100000:2.0:1787862557.852740:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402816 00000100:00100000:2.0:1787862557.852816:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787862557.852829:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526402816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862557.852847:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862557.852868:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fd74 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862557.852902:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862557.852928:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862557.852939:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:2.0:1787862557.852989:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526402816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862557.852997:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787862557.855329:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526402816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862557.855373:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.855389:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862557.855499:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526402944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862557.855587:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862557.855645:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509897b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862557.862029:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526402944 00000100:00100000:1.0:1787862557.862069:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526402944 00000100:00100000:1.0:1787862557.862168:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787862557.862181:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526402944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.862587:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526402944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 408us (6999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862557.862597:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787862557.867221:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526402944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862557.867314:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862557.867413:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862557.867538:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862557.868895:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403072 00000100:00100000:3.0:1787862557.868915:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403072 00000100:00100000:3.0:1787862557.868990:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787862557.869002:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526403072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862557.869338:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526403072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862557.869358:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787862557.869434:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787862557.871697:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787862557.874079:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787862557.874140:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862557.874155:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.874170:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862557.874185:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862557.874189:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a653d6d2000 from 7 10000000:01000000:1.0:1787862557.874192:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862557.874252:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.874262:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.874276:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862557.874313:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.874435:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862557.874523:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403200 00000100:00100000:3.0:1787862557.874533:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403200 00000100:00100000:3.0:1787862557.874601:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787862557.874612:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526403200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862557.874628:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862557.874643:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fd82 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.874683:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.874696:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.874706:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031c00, rc 0) 00000100:00100000:3.0:1787862557.874757:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526403200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862557.874766:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787862557.877088:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc25300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862557.877188:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862557.877227:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862557.877243:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862557.877360:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862557.877437:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862557.877477:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862557.878168:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403328 00000100:00100000:1.0:1787862557.878178:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403328 00000100:00100000:1.0:1787862557.878250:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787862557.878260:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526403328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.878595:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526403328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862557.878604:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787862557.882126:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862557.882217:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862557.882321:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862557.882372:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65056af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862557.882488:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403456 00000100:00100000:1.0:1787862557.882496:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403456 00000100:00100000:1.0:1787862557.882560:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787862557.882571:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526403456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.882879:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526403456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862557.882887:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787862557.889546:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787862557.893945:0:11179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787862557.894111:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787862557.894148:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862557.894165:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.894180:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862557.894194:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862557.894198:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a65091a1800 from 7 10000000:01000000:1.0:1787862557.894201:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862557.894257:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.894266:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.894300:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862557.894334:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.894430:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862557.894493:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862557.900263:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403584 00000100:00100000:3.0:1787862557.900283:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403584 00000100:00100000:3.0:1787862557.900368:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787862557.900380:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526403584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862557.900404:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862557.900446:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fd90 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.900483:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.900497:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.900507:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031800, rc 0) 00000100:00100000:3.0:1787862557.900605:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526403584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (6174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862557.900613:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787862557.909795:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862557.909837:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862557.909862:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862557.909975:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.910122:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862557.910173:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc250c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862557.910315:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403712 00000100:00100000:2.0:1787862557.910324:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403712 00000100:00100000:2.0:1787862557.910389:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787862557.910401:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526403712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862557.910772:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526403712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862557.910784:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787862557.919373:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.919466:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.919591:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862557.919642:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc250c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862557.919667:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403840 00000100:00100000:1.0:1787862557.919675:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403840 00000100:00100000:1.0:1787862557.919750:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787862557.919762:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526403840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862557.920038:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526403840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862557.920094:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787862557.920169:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526403840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787862557.929173:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787862557.929260:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787862557.929285:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862557.929300:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862557.929327:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862558.302134:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862558.368683:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526403968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862558.368775:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862558.368840:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526403968 00000100:00100000:0.0:1787862558.368847:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526403968 00000100:00100000:0.0:1787862558.368907:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862558.368917:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526403968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862558.368950:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862558.368985:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526403968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862558.368990:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787862558.369015:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862558.369038:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e87480 x1874709526403968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862558.369114:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526403968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862559.324298:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862560.350528:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862560.976082:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862560.976148:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862560.976184:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862560.976230:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927872 00000100:00100000:1.0:1787862560.976244:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927872 00000100:00100000:1.0:1787862560.976322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927744 00000100:00100000:1.0:1787862560.976325:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927744 00000100:00100000:1.0:1787862560.976353:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:1.0:1787862560.976365:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516927872:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862560.976468:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516927616 00000100:00100000:2.0:1787862560.976473:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516927616 00000100:00100000:2.0:1787862560.976507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 253 00000100:00100000:2.0:1787862560.976515:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516927616:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862560.976597:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516927616:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 83us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862560.976620:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 253 00000100:00100000:1.0:1787862560.977001:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516927872:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 637us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862560.977008:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:1.0:1787862560.977027:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:1.0:1787862560.977034:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516927744:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862560.977078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516927744:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 44us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862560.977084:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00080000:1.0:1787862560.977105:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862561.375502:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862561.441512:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526404096:0@lo:400:kworker.0 00000100:00100000:1.0:1787862561.441603:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862561.441705:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404096 00000100:00100000:3.0:1787862561.441715:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404096 00000100:00100000:3.0:1787862561.441763:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787862561.441773:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526404096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862561.447263:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526404096:12345-0@lo:400:kworker.0 Request processed in 5480us (5649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862561.447297:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787862561.447521:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401991a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526404224:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.447581:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862561.447608:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401990f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526404736:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.447632:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862561.447650:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862561.447654:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401990780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526404608:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.447674:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862561.447712:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401991e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526404480:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.447738:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862561.447759:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862561.447765:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526404352:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.447787:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862561.447813:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404736 00000100:00100000:0.0:1787862561.447821:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404736 00000100:00100000:0.0:1787862561.447870:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404480 00000100:00100000:0.0:1787862561.447873:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404480 00000100:00100000:0.0:1787862561.447890:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862561.447900:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526404736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.447949:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526404736:12345-0@lo:400:kworker.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862561.448187:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862561.448213:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862561.448220:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.448257:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526404480:12345-0@lo:400:kworker.0 Request processed in 38us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862561.448263:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787862561.448302:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401991e00 x1874709526404480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862561.448317:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401991e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526404480:0@lo:400:kworker.0 00010000:00080000:0.0:1787862561.448347:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401990f00 x1874709526404736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862561.448355:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401990f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526404736:0@lo:400:kworker.0 00000100:00100000:1.0:1787862561.448919:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526404096:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.449612:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404224 00000100:00100000:0.0:1787862561.449621:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404224 00000100:00100000:0.0:1787862561.449662:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404608 00000100:00100000:0.0:1787862561.449665:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404608 00000100:00100000:0.0:1787862561.449681:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404352 00000100:00100000:0.0:1787862561.449684:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404352 00000100:00100000:0.0:1787862561.449712:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787862561.449720:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526404224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.449785:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526404224:12345-0@lo:400:kworker.0 Request processed in 65us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862561.449792:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787862561.449809:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787862561.449815:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401993840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526404608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.449845:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401993840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526404608:12345-0@lo:400:kworker.0 Request processed in 30us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862561.449861:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787862561.449873:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787862561.449879:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401991680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.449914:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401991680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526404352:12345-0@lo:400:kworker.0 Request processed in 35us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862561.449919:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787862561.450617:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526404352:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.450744:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401990780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526404608:0@lo:400:kworker.0 00000100:00100000:0.0:1787862561.450757:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401991a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526404224:0@lo:400:kworker.0 00000100:00080000:1.0:1787862561.455924:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862561.455937:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862561.455940:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862561.949313:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862561.949337:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526404864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862561.949432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862561.949516:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404864 00000100:00100000:2.0:1787862561.949524:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404864 00000100:00100000:2.0:1787862561.949575:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787862561.949585:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526404864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862561.949636:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862561.949702:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526404864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862561.949711:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787862561.949760:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e84f00 x1874709526404864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862561.949793:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526404864:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787862562.100771:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787862562.411591:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862563.420459:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862563.484449:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862563.484473:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526404992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862563.484558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862563.484616:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526404992 00000100:00100000:2.0:1787862563.484623:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526404992 00000100:00100000:2.0:1787862563.484686:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787862563.484697:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526404992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862563.484740:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862563.484779:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526404992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862563.484801:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787862563.484823:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862563.484849:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e84f00 x1874709526404992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862563.484865:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526404992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862564.446071:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862565.468973:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862566.103631:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862566.103745:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862566.103787:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862566.103960:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928256 00000100:00100000:3.0:1787862566.103970:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928256 00000100:00100000:3.0:1787862566.104039:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928128 00000100:00100000:3.0:1787862566.104076:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928128 00000100:00100000:2.0:1787862566.104189:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928000 00000100:00100000:2.0:1787862566.104193:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928000 00000100:00100000:2.0:1787862566.104227:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 255 00000100:00100000:2.0:1787862566.104236:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516928000:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862566.104308:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516928000:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 73us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862566.104316:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 255 00000100:00080000:1.0:1787862566.104440:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862566.104582:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:3.0:1787862566.104591:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516928256:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862566.104627:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516928256:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 38us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862566.104633:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:3.0:1787862566.104647:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:3.0:1787862566.104664:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516928128:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862566.105140:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516928128:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 485us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862566.105148:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00010000:00010000:3.0:1787862566.493416:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862566.557067:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401990780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526405248:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557157:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862566.557223:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526405760:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862566.557283:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787862566.557289:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401991a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526405120:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557317:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862566.557339:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401991e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526405632:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557362:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862566.557387:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401990f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526405504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557423:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862566.557442:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862566.557447:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526405376:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557484:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862566.557510:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405760 00000100:00100000:0.0:1787862566.557517:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405760 00000100:00100000:0.0:1787862566.557560:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405504 00000100:00100000:0.0:1787862566.557563:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405504 00000100:00100000:0.0:1787862566.557581:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862566.557589:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526405760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557637:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526405760:12345-0@lo:400:kworker.0 Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862566.557644:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862566.557676:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862566.557682:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401993c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526405504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557713:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401993c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526405504:12345-0@lo:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862566.557719:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862566.557737:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405120 00000100:00100000:0.0:1787862566.557740:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405120 00000100:00100000:0.0:1787862566.557760:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787862566.557766:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557796:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526405120:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862566.557803:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787862566.557833:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405248 00000100:00100000:0.0:1787862566.557836:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405248 00000100:00100000:0.0:1787862566.557855:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405632 00000100:00100000:0.0:1787862566.557858:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405632 00000100:00100000:0.0:1787862566.557871:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405376 00000100:00100000:0.0:1787862566.557873:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405376 00000100:00100000:0.0:1787862566.557898:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862566.557904:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401992940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557933:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401992940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526405248:12345-0@lo:400:kworker.0 Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862566.557939:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862566.557951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787862566.557957:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401992d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526405632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.557983:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401992d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526405632:12345-0@lo:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862566.557989:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787862566.558000:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787862566.558006:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401992580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526405376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.558031:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401992580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526405376:12345-0@lo:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862566.558037:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787862566.558102:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526405376:0@lo:400:kworker.0 00010000:00080000:0.0:1787862566.558116:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401990f00 x1874709526405504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862566.558127:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401990f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526405504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.558160:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401991a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526405120:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.558169:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401991e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526405632:0@lo:400:kworker.0 00000100:00100000:0.0:1787862566.558180:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401990780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526405248:0@lo:400:kworker.0 00010000:00080000:0.0:1787862566.558188:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a64019912c0 x1874709526405760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862566.558204:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526405760:0@lo:400:kworker.0 00000100:00080000:1.0:1787862566.558721:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862566.558727:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862566.558729:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862567.068399:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862567.068428:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526405888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862567.068511:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862567.068671:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526405888 00000100:00100000:2.0:1787862567.068679:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526405888 00000100:00100000:2.0:1787862567.068731:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862567.068740:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526405888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862567.068777:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862567.068824:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526405888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862567.068831:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787862567.069103:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e86580 x1874709526405888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862567.069122:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526405888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862567.519359:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862568.543607:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862568.569896:0:11457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:29:25 (1787862565) === 00000100:00100000:2.0:1787862568.604615:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862568.605001:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526406016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862568.605726:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862568.606131:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406016 00000100:00100000:0.0:1787862568.606140:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406016 00000100:00080000:1.0:1787862568.606437:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862568.606546:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862568.606559:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526406016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862568.606607:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862568.607037:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526406016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 481us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862568.607079:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787862568.609577:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e86d00 x1874709526406016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862568.609604:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526406016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862568.941568:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862568.941610:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862568.941780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928384 00000100:00100000:0.0:1787862568.941791:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928384 00000100:00100000:0.0:1787862568.941859:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:0.0:1787862568.941870:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516928384:12345-192.168.202.60@tcp:41:mkdir.0 00000004:00000024:0.0:1787862568.941918:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787862568.942609:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862568.951166:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928512 00000100:00100000:1.0:1787862568.951184:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928512 00000100:00100000:1.0:1787862568.951248:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1787862568.951260:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:21567a16-68b5-41a8-a3f6-27f314a231da+7:9670:x1874709516928512:12345-192.168.202.60@tcp:700:mkdir.0 00000100:00100000:3.0:1787862568.969279:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709516928384:12345-192.168.202.60@tcp:41:mkdir.0 Request processed in 27395us (27714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862568.969295:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:1.0:1787862568.970272:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:21567a16-68b5-41a8-a3f6-27f314a231da+6:9670:x1874709516928512:12345-192.168.202.60@tcp:700:mkdir.0 Request processed in 19008us (28654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862568.970286:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1787862569.001957:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862569.001995:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928768 00000100:00100000:1.0:1787862569.002004:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928768 00000100:00100000:1.0:1787862569.002077:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787862569.002090:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:9670:x1874709516928768:12345-192.168.202.60@tcp:36:mkdir.0 00010000:00010000:1.0:1787862569.002157:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862569.002227:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf892fc7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345c9 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.002249:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880400) 00010000:00010000:1.0:1787862569.002261:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862569.002610:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.002862:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.002875:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.002907:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.002915:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.002934:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862569.013233:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787862569.013253:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.013264:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.013272:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.013278:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862569.013282:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.013289:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.013305:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880c00) 00010000:00010000:1.0:1787862569.013308:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862569.013313:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.013319:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf892fd9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862569.013341:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000406d1bfe reply state 000000002685d8ed transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862569.013368:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862569.018602:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:9670:x1874709516928768:12345-192.168.202.60@tcp:36:mkdir.0 Request processed in 16503us (16640us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787862569.018617:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00010000:00010000:3.0:1787862569.053247:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.053267:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.053288:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.053295:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862569.053300:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.053309:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.053330:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6516880a00) 00010000:00010000:3.0:1787862569.053333:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862569.053339:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.053344:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf892fda5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862569.057664:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862569.059588:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516928896 00000100:00100000:0.0:1787862569.059602:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516928896 00000100:00100000:0.0:1787862569.059692:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1787862569.059704:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:9671:x1874709516928896:12345-192.168.202.60@tcp:101:chmod.0 00010000:00010000:0.0:1787862569.059727:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862569.059751:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fdac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3464e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.060029:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf892fdb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.060589:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf892fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.060605:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf892fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862569.061395:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787862569.061399:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862569.062952:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf892fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.063004:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fdac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3464e expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.063029:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf892fdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3464e expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.063038:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517dfc600) 00010000:00010000:0.0:1787862569.063573:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862569.063579:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918000, rc 0) 00000100:00100000:0.0:1787862569.064003:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:9671:x1874709516928896:12345-192.168.202.60@tcp:101:chmod.0 Request processed in 4298us (6344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862569.064014:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1787862569.083773:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862569.083903:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516929152 00000100:00100000:1.0:1787862569.083914:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516929152 00000100:00100000:1.0:1787862569.083973:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862569.083984:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:9671:x1874709516929152:12345-192.168.202.60@tcp:36:chmod.0 00010000:00010000:1.0:1787862569.084038:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862569.084104:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf892fdb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3464e expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.084122:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517dfc600) 00010000:00010000:1.0:1787862569.084132:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862569.084159:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.084171:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.084180:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862569.084519:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b17e5374 reply state 000000000e67c05b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862569.084529:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787862569.084550:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787862569.084644:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+8:9671:x1874709516929152:12345-192.168.202.60@tcp:36:chmod.0 Request processed in 661us (887us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787862569.084651:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00010000:00010000:3.0:1787862569.094939:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.094957:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.094966:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.094972:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862569.094977:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.095000:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.095016:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880c00) 00010000:00010000:3.0:1787862569.095019:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787862569.095024:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.095030:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892fdba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862569.130527:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862569.130890:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516929280 00000100:00100000:3.0:1787862569.130902:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516929280 00000100:00100000:3.0:1787862569.130963:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862569.130972:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:9672:x1874709516929280:12345-192.168.202.60@tcp:101:chown.0 00010000:00010000:3.0:1787862569.130997:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862569.131018:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fdc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34655 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.131122:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf892fdc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.131136:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf892fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.131147:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf892fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862569.131907:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787862569.131914:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862569.131965:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf892fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.131996:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fdc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34655 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.132019:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf892fdc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34655 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.132028:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:2.0:1787862569.132032:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862569.132036:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030c00, rc 0) 00000100:00100000:2.0:1787862569.132145:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:9672:x1874709516929280:12345-192.168.202.60@tcp:101:chown.0 Request processed in 1171us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862569.132154:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:0.0:1787862569.138655:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862569.138738:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516929408 00000100:00100000:1.0:1787862569.138747:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516929408 00000100:00100000:1.0:1787862569.138804:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787862569.138814:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401991e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+8:9672:x1874709516929408:12345-192.168.202.60@tcp:101:chown.0 00010000:00010000:1.0:1787862569.138832:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862569.138853:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fdcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3465c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.138913:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.138927:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.138938:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.138951:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.138958:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.138965:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139097:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892fde4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139120:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139127:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862569.139162:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787862569.139387:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862569.139417:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139525:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139532:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139539:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139545:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862569.139549:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139558:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139569:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:1.0:1787862569.139572:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862569.139576:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139592:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fdd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139606:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139612:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139618:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139633:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862569.139636:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139642:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139649:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6516880400) 00010000:00010000:1.0:1787862569.139652:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862569.139655:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139660:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139698:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fdcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3465c expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139711:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3465c expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.139724:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6516880f00) 00010000:00010000:1.0:1787862569.139726:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862569.139729:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f600, rc 0) 00000100:00100000:2.0:1787862569.139846:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401991e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:9672:x1874709516929408:12345-192.168.202.60@tcp:101:chown.0 Request processed in 1031us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862569.139856:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:0.0:1787862569.147786:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.148430:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516929664 00000100:00100000:2.0:1787862569.148441:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516929664 00000100:00100000:2.0:1787862569.148507:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787862569.148517:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401991a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:9672:x1874709516929664:12345-192.168.202.60@tcp:36:chown.0 00010000:00010000:2.0:1787862569.148586:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862569.148614:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892fde4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3465c expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.148647:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6516880f00) 00010000:00010000:2.0:1787862569.148659:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862569.148684:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.148697:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.148707:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862569.247005:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbc0ab0c reply state 000000008d114f2e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862569.247023:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787862569.247229:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787862569.247335:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401991a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+10:9672:x1874709516929664:12345-192.168.202.60@tcp:36:chown.0 Request processed in 98806us (99545us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787862569.247344:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000001:00080000:1.0:1787862569.252425:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787862569.252462:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1787862569.252591:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.252604:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.252612:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.252644:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862569.252650:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.252658:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.252677:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6a00) 00010000:00010000:0.0:1787862569.252680:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787862569.252685:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.252692:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862569.286357:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.286477:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516929792 00000100:00100000:2.0:1787862569.286486:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516929792 00000100:00100000:2.0:1787862569.286543:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862569.286552:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:9673:x1874709516929792:12345-192.168.202.60@tcp:101:touch.500 00010000:00010000:2.0:1787862569.286575:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862569.286595:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fdf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34663 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862569.288298:0:7147:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1630us 00010000:00010000:2.0:1787862569.338872:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.338896:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.338908:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.338923:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.338930:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.338936:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339451:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892fe07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339461:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339469:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862569.339542:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862569.339547:0:7147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862569.339662:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339677:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339683:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339690:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339696:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862569.339699:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339707:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339718:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:2.0:1787862569.339721:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862569.339726:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339731:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fdf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339744:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339750:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339755:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339766:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862569.339769:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339775:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339783:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862569.339785:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862569.339788:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339794:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339837:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fdf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34663 expref: 8 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339853:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892fe07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34663 expref: 7 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.339861:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862569.339863:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862569.339865:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:2.0:1787862569.339935:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:9673:x1874709516929792:12345-192.168.202.60@tcp:101:touch.500 Request processed in 53383us (53585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862569.339945:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862569.345034:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862569.345213:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516930048 00000100:00100000:1.0:1787862569.345225:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516930048 00000100:00100000:1.0:1787862569.345288:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787862569.345298:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:9673:x1874709516930048:12345-192.168.202.60@tcp:101:touch.500 00010000:00010000:1.0:1787862569.345328:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862569.345349:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fe0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3466a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.345673:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.345687:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.345697:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.345751:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.345758:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.345764:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862569.346532:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787862569.346783:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892fe23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346794:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346803:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346836:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346843:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346849:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346856:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862569.346861:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346869:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346880:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787862569.346884:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862569.346888:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346906:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fe00/0x9c5536ccf892fe15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862569.346921:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021e64d61 reply state 00000000703c9071 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862569.346930:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787862569.346961:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fe0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3466a expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346976:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3466a expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.346984:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6516880f00) 00010000:00010000:1.0:1787862569.346986:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862569.346988:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f400, rc 0) 00000100:00100000:1.0:1787862569.347091:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+10:9673:x1874709516930048:12345-192.168.202.60@tcp:101:touch.500 Request processed in 1793us (2065us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787862569.347100:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00010000:00010000:0.0:1787862569.361872:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.361889:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.361908:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.361915:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862569.361920:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.361928:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.361962:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9a6516880400) 00010000:00010000:0.0:1787862569.361965:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862569.361970:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.361977:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fe1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862569.365791:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862569.365852:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516930304 00000100:00100000:3.0:1787862569.365862:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516930304 00000100:00100000:3.0:1787862569.365930:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:3.0:1787862569.365940:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:9673:x1874709516930304:12345-192.168.202.60@tcp:36:touch.500 00010000:00010000:3.0:1787862569.365994:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862569.366017:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892fe23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3466a expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.366038:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6516880f00) 00010000:00010000:3.0:1787862569.366084:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862569.366127:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.366139:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.366149:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862569.366293:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d418c329 reply state 00000000b2e522f3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862569.366303:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862569.366392:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+10:9673:x1874709516930304:12345-192.168.202.60@tcp:36:touch.500 Request processed in 452us (610us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787862569.366400:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00010000:00010000:0.0:1787862569.373641:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.373659:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.373667:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.373678:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862569.373683:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.373691:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.373709:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:0.0:1787862569.373712:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862569.373717:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.373724:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf892fe31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862569.382835:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862569.383070:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516930432 00000100:00100000:1.0:1787862569.383081:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516930432 00000100:00100000:1.0:1787862569.383140:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:1.0:1787862569.383150:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:9673:x1874709516930432:12345-192.168.202.60@tcp:101:touch.500 00010000:00010000:1.0:1787862569.383188:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862569.383214:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fe38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34671 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.383286:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fe38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34671 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.383300:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fe38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34671 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862569.383327:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6516880c00) 00010000:00010000:1.0:1787862569.383330:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862569.383334:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204e800, rc 0) 00000100:00100000:1.0:1787862569.383388:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+10:9673:x1874709516930432:12345-192.168.202.60@tcp:101:touch.500 Request processed in 240us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862569.383395:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:3.0:1787862569.386886:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862569.388078:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516930560 00000100:00100000:0.0:1787862569.388096:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516930560 00000100:00100000:0.0:1787862569.388155:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1787862569.388173:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874709516930560:12345-192.168.202.60@tcp:8:touch.500 00010000:00080000:0.0:1787862569.388212:0:6671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1787862569.388245:0:6671:0:(genops.c:1385:class_connect()) connect: client 21567a16-68b5-41a8-a3f6-27f314a231da, cookie 0x9c5536ccf892fe3f 00002000:00100000:0.0:1787862569.388258:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 21567a16-68b5-41a8-a3f6-27f314a231da/ffff9a6537e6a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787862569.388271:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1787862569.388533:0:6671:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787862569.388564:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a6537e6a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862569.388639:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2345:x1874709516930560:12345-192.168.202.60@tcp:8:touch.500 Request processed in 475us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862569.388648:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1787862569.394944:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862569.395026:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516930688 00000100:00100000:0.0:1787862569.395036:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516930688 00000100:00100000:0.0:1787862569.395166:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:0.0:1787862569.395176:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:0:x1874709516930688:12345-192.168.202.60@tcp:2:touch.500 00000100:00080000:1.0:1787862569.395647:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787862569.482304:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787862569.482328:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000100:00100000:0.0:1787862569.482543:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:0:x1874709516930688:12345-192.168.202.60@tcp:2:touch.500 Request processed in 87364us (87605us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787862569.482555:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862569.485723:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862569.486294:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516930944 00000100:00100000:3.0:1787862569.486316:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516930944 00000100:00100000:3.0:1787862569.486464:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1787862569.486474:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+10:9673:x1874709516930944:12345-192.168.202.60@tcp:35:touch.500 00000100:00100000:3.0:1787862569.486834:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+11:9673:x1874709516930944:12345-192.168.202.60@tcp:35:touch.500 Request processed in 360us (1119us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787862569.486841:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1787862569.498927:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.499008:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516931072 00000100:00100000:2.0:1787862569.499018:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516931072 00000100:00100000:2.0:1787862569.499112:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:2.0:1787862569.499123:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+11:9674:x1874709516931072:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1787862569.499150:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862569.499181:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34678 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.499247:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.499261:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.499273:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862569.499337:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862569.499340:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862569.499391:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.499417:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34678 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.499434:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34678 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.499443:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862569.499446:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862569.499460:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd200, rc 0) 00000100:00100000:2.0:1787862569.499515:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+12:9674:x1874709516931072:12345-192.168.202.60@tcp:101:rm.0 Request processed in 394us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862569.499522:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:0.0:1787862569.508345:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.508484:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516931328 00000100:00100000:2.0:1787862569.508494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516931328 00000100:00100000:2.0:1787862569.508550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:2.0:1787862569.508559:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+12:9674:x1874709516931328:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1787862569.508579:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862569.508597:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3467f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862569.508804:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787862569.508962:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3467f expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.508976:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:2.0:1787862569.508979:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862569.508985:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3467f expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.508996:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:2.0:1787862569.509176:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+13:9674:x1874709516931328:12345-192.168.202.60@tcp:101:rm.0 Request processed in 616us (838us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787862569.509184:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1787862569.520400:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.522179:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516931456 00000100:00100000:2.0:1787862569.522192:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516931456 00000100:00100000:2.0:1787862569.522267:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1787862569.522289:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+13:9674:x1874709516931456:12345-192.168.202.60@tcp:37:rm.0 00000100:00100000:2.0:1787862569.531648:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+13:9674:x1874709516931456:12345-192.168.202.60@tcp:37:rm.0 Request processed in 9349us (11245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862569.531661:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:0.0:1787862569.542892:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862569.543024:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516931712 00000100:00100000:3.0:1787862569.543034:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516931712 00000100:00100000:3.0:1787862569.543156:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:3.0:1787862569.543437:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+13:9674:x1874709516931712:12345-192.168.202.60@tcp:35:rm.0 00000100:00100000:3.0:1787862569.543714:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+14:9674:x1874709516931712:12345-192.168.202.60@tcp:35:rm.0 Request processed in 289us (831us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787862569.554495:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:1.0:1787862569.555983:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.556083:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516931968 00000100:00100000:2.0:1787862569.556096:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516931968 00000100:00100000:2.0:1787862569.556203:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:2.0:1787862569.556213:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+14:9674:x1874709516931968:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:2.0:1787862569.556237:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862569.556256:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34686 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.556383:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fe69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.556398:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fe69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.556410:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fe69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862569.556420:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787862569.556556:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892fe62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34686 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.556575:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fe69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34686 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.556602:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862569.556605:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862569.556609:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:2.0:1787862569.556686:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516931968:12345-192.168.202.60@tcp:101:rm.0 Request processed in 474us (708us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787862569.556693:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:3.0:1787862569.559726:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862569.562639:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516932096 00000100:00100000:0.0:1787862569.562903:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516932096 00000100:00100000:0.0:1787862569.563455:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:0.0:1787862569.563469:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516932096:12345-192.168.202.60@tcp:41:rm.0 00000004:00000024:0.0:1787862569.563544:0:7147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787862569.563640:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516932096:12345-192.168.202.60@tcp:41:rm.0 Request processed in 174us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862569.563648:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00010000:00010000:0.0:1787862569.567406:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862569.567709:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862569.567780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516932224 00000100:00100000:3.0:1787862569.567789:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516932224 00000100:00100000:3.0:1787862569.567869:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:3.0:1787862569.567880:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516932224:12345-192.168.202.60@tcp:101:rm.0 00010000:00010000:3.0:1787862569.567898:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862569.567916:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684600/0x9c5536ccf892fe77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3468d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.567970:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.567983:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568006:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568020:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568027:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568033:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568274:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568283:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568289:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862569.568315:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862569.568424:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862569.568444:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568456:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568464:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568480:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568487:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568493:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501684a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862569.568497:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568504:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568575:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:3.0:1787862569.568579:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862569.568585:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568592:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892fe7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568605:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568611:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568617:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568631:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862569.568639:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568646:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568654:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9a6517c53600) 00010000:00010000:3.0:1787862569.568656:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862569.568660:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568666:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892fe85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568696:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684600/0x9c5536ccf892fe77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3468d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568708:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3468d expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.568715:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6516880c00) 00010000:00010000:3.0:1787862569.568718:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862569.568720:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501684400, rc 0) 00000100:00100000:3.0:1787862569.568823:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+17:9674:x1874709516932224:12345-192.168.202.60@tcp:101:rm.0 Request processed in 945us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862569.568831:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:0.0:1787862569.579766:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.579957:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516932480 00000100:00100000:2.0:1787862569.579969:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516932480 00000100:00100000:2.0:1787862569.580027:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:2.0:1787862569.580037:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+17:9674:x1874709516932480:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:2.0:1787862569.580139:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787862569.580393:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892fe8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3468d expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.580420:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892fe38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34671 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.580433:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6516880c00) 00010000:00010000:2.0:1787862569.580448:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892fe4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34678 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.580462:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862569.580465:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862569.580542:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580555:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580565:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580580:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580587:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580593:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580721:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580745:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.580752:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862569.581963:0:7147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787862569.581974:0:7147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295345931223ns, next at 296345929172ns, rc = 0 00010000:00010000:0.0:1787862569.582630:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582645:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582656:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582665:0:7147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582673:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582679:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582703:0:7147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862569.582728:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582734:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582750:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582757:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862569.582761:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582770:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582784:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6517dfcf00) 00010000:00010000:0.0:1787862569.582786:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787862569.582792:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582799:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918a00/0x9c5536ccf892fea1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582820:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582827:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582833:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582838:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862569.582840:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582855:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582863:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:0.0:1787862569.582866:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862569.582869:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.582874:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf892fe93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862569.582884:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad746a23 reply state 00000000f1861c6a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862569.582892:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862569.582996:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516932480:12345-192.168.202.60@tcp:36:rm.0 Request processed in 2954us (3234us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787862569.583005:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00010000:00010000:3.0:1787862569.583504:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862569.583516:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.583533:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862569.583536:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.583543:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.583553:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6517dfcf00) 00010000:00010000:3.0:1787862569.583555:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862569.583558:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.583564:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf892fea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.583579:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862569.583581:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862569.583583:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862569.587649:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.587665:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.587673:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.587679:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862569.587684:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.587709:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.587724:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9a6517dfca00) 00010000:00010000:3.0:1787862569.587726:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862569.587731:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862569.587737:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf892fe9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862569.588508:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.588754:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516932736 00000100:00100000:2.0:1787862569.588765:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516932736 00000100:00100000:2.0:1787862569.588821:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1787862569.588831:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+15:9674:x1874709516932736:12345-192.168.202.60@tcp:35:rm.0 00000100:00100000:2.0:1787862569.589126:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516932736:12345-192.168.202.60@tcp:35:rm.0 Request processed in 296us (621us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787862569.589135:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1787862569.591919:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862569.591988:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516932992 00000100:00100000:2.0:1787862569.591997:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516932992 00000100:00100000:2.0:1787862569.592120:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:2.0:1787862569.592130:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:9674:x1874709516932992:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:2.0:1787862569.592182:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787862569.592206:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892fe69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34686 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592225:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892fe07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34663 expref: 15 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592235:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862569.592250:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf892fdc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34655 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592260:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53300) 00010000:00010000:2.0:1787862569.592265:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862569.592285:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592297:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592333:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592345:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592352:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592359:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592634:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592643:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.592650:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862569.594000:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787862569.594020:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594028:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594036:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594076:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862569.594089:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594098:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594112:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:2.0:1787862569.594114:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787862569.594118:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594125:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892febd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594149:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594155:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594160:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594166:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862569.594169:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594175:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594181:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862569.594183:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862569.594191:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862569.594197:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf892feaf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862569.594216:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004601bcff reply state 000000005446c8d3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862569.594226:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862569.594308:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:9674:x1874709516932992:12345-192.168.202.60@tcp:36:rm.0 Request processed in 2178us (2393us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787862569.594324:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00010000:00010000:0.0:1787862569.600167:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.600187:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.600195:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.600201:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862569.600222:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.600230:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.600247:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862569.600251:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862569.600256:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862569.600263:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892feb6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862570.591464:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862571.214860:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862571.214922:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862571.214952:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862571.214988:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933120 00000100:00100000:3.0:1787862571.214999:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933120 00000100:00100000:3.0:1787862571.215093:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 257 00000100:00100000:3.0:1787862571.215105:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516933120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862571.215486:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516933120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 382us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862571.215494:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 257 00000100:00100000:3.0:1787862571.215532:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933248 00000100:00100000:3.0:1787862571.215537:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933248 00000100:00100000:3.0:1787862571.215574:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933504 00000100:00100000:3.0:1787862571.215577:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933504 00000100:00100000:3.0:1787862571.215596:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:3.0:1787862571.215631:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+14:2349:x1874709516933248:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862571.215688:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+14:2349:x1874709516933248:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 84us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862571.215694:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:3.0:1787862571.215706:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:3.0:1787862571.215712:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516933504:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862571.215734:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516933504:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862571.215740:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:3.0:1787862571.223251:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00080000:3.0:1787862571.235360:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862571.235409:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933376 00000100:00100000:3.0:1787862571.235420:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933376 00000100:00100000:3.0:1787862571.235499:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1787862571.235512:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516933376:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862571.235614:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516933376:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 95us (12427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862571.235623:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00080000:3.0:1787862571.235649:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862571.617127:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862571.678782:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526406144:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.678896:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862571.678947:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526406656:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.678973:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862571.679001:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787862571.679006:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526406272:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679030:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862571.679065:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526406784:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679090:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862571.679133:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526406400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679158:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862571.679179:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862571.679185:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526406528:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679207:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862571.679242:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406144 00000100:00100000:1.0:1787862571.679248:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406144 00000100:00100000:1.0:1787862571.679297:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787862571.679307:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526406144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679358:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526406144:12345-0@lo:400:kworker.0 Request processed in 53us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862571.679366:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787862571.679399:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406656 00000100:00100000:1.0:1787862571.679404:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406656 00000100:00100000:1.0:1787862571.679440:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406272 00000100:00100000:1.0:1787862571.679442:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406272 00000100:00100000:1.0:1787862571.679455:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406400 00000100:00100000:1.0:1787862571.679457:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406400 00000100:00100000:1.0:1787862571.679471:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787862571.679477:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526406656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679510:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526406656:12345-0@lo:400:kworker.0 Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862571.679517:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787862571.679529:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787862571.679535:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679561:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526406272:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862571.679575:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787862571.679587:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787862571.679593:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526406400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679638:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526406400:12345-0@lo:400:kworker.0 Request processed in 45us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862571.679645:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787862571.679665:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406784 00000100:00100000:1.0:1787862571.679669:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406784 00000100:00100000:1.0:1787862571.679694:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406528 00000100:00100000:1.0:1787862571.679698:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406528 00000100:00100000:1.0:1787862571.679714:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862571.679719:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679762:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526406784:12345-0@lo:400:kworker.0 Request processed in 43us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862571.679769:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862571.679780:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787862571.679786:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526406528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679811:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526406528:12345-0@lo:400:kworker.0 Request processed in 25us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862571.679816:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787862571.679840:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862571.679844:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862571.679847:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787862571.679875:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec4b40 x1874709526406528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862571.679890:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526406528:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679907:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526406400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679934:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526406272:0@lo:400:kworker.0 00010000:00080000:1.0:1787862571.679944:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6518ec5680 x1874709526406784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862571.679951:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526406784:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679959:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526406144:0@lo:400:kworker.0 00000100:00100000:1.0:1787862571.679969:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526406656:0@lo:400:kworker.0 00000100:00100000:0.0:1787862572.197966:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862572.198686:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526406912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862572.198760:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862572.198876:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526406912 00000100:00100000:2.0:1787862572.198885:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526406912 00000100:00100000:2.0:1787862572.198986:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787862572.198996:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526406912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862572.199035:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862572.199115:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526406912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862572.199123:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787862572.199163:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e84b40 x1874709526406912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862572.199181:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526406912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862572.637509:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862573.662235:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787862573.726513:0:6937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299490467497ns, next at 300490464257ns, rc = 0 00000100:00100000:2.0:1787862573.726546:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526407040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862573.726635:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862573.726729:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526407040 00000100:00100000:2.0:1787862573.726737:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526407040 00000100:00100000:2.0:1787862573.726797:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862573.726808:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526407040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862573.726844:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862573.726887:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526407040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862573.726895:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787862573.726935:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e87840 x1874709526407040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862573.726954:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526407040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787862573.727024:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787862574.276262:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1787862574.276277:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1787862574.276299:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787862574.276305:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787862574.276447:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526407168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787862574.276519:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862574.276614:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526407168 00000100:00100000:0.0:1787862574.276621:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526407168 00000100:00100000:0.0:1787862574.276684:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862574.276694:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526407168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787862574.276722:0:6672:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787862574.276759:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a909e29, atime: 0x6a909e29, ctime: 0x6a909e29, blocks: 0x1 00010000:00010000:0.0:1787862574.276782:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.276798:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1787862574.276802:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862574.276809:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.276828:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.276839:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.276847:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.276866:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787862574.277476:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526407168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 781us (955us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787862574.277485:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787862574.277518:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862574.277525:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.277535:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862574.277541:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.277557:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.277587:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.277596:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf892fec4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862574.277615:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862574.277617:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862574.277619:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787862574.277653:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a653dc8bc00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787862574.277660:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526407168:0@lo:6:osp-syn-0-0.0 00000001:02000400:2.0:1787862574.495540:0:11608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787862574.693838:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787862574.780682:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1787862575.709687:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787862575.930742:0:11657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2f4cac30 20000000:00000080:2.0:1787862575.930761:0:11657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a653d9e1800 uarg=0000000000000000 20000000:01000000:2.0:1787862575.930798:0:11657:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787862575.930805:0:11657:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787862575.930810:0:11657:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787862575.934997:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787862575.937292:0:11657:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787862575.945642:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787862575.945693:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787862575.945737:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787862575.945753:0:11657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787862575.945773:0:11657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.945794:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.945813:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.945821:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.945828:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.945835:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.945842:0:11657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.953013:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.953033:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 18 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862575.953462:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407296:0@lo:104: 00000100:00100000:3.0:1787862575.962000:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862575.962173:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.962189:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 18 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.962224:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407424:0@lo:104: 00000100:00100000:3.0:1787862575.962255:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862575.962977:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.962989:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 18 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.963000:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407552:0@lo:104: 00000100:00100000:3.0:1787862575.963032:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862575.968395:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526407296 00000100:00100000:2.0:1787862575.968411:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526407296 00000100:00100000:2.0:1787862575.968470:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526407424 00000100:00100000:2.0:1787862575.968474:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526407424 00000100:00100000:2.0:1787862575.968492:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862575.968503:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:11657:x1874709526407296:12345-0@lo:104: 00010000:00010000:2.0:1787862575.968521:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.968649:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862575.968655:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+4:11657:x1874709526407296:12345-0@lo:104: Request processed in 155us (6664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862575.968662:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862575.968681:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862575.968688:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:11657:x1874709526407424:12345-0@lo:104: 00010000:00010000:2.0:1787862575.968695:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.968730:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787862575.968735:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:11657:x1874709526407424:12345-0@lo:104: Request processed in 48us (6480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862575.968741:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787862575.969324:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787862575.969340:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526407552 00000100:00100000:0.0:1787862575.969344:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526407552 00000100:00100000:0.0:1787862575.969368:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862575.969376:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:11657:x1874709526407552:12345-0@lo:104: 00010000:00010000:0.0:1787862575.969388:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862575.969439:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787862575.969446:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+3:11657:x1874709526407552:12345-0@lo:104: Request processed in 71us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862575.969463:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787862575.969621:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.969637:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.969652:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400ab0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407680:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862575.969725:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.969739:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.969750:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407808:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862575.969779:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862575.969815:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407296:0@lo:104: 00000100:00100000:3.0:1787862575.969838:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407424:0@lo:104: 00000100:00100000:3.0:1787862575.969944:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407552:0@lo:104: 00010000:00010000:3.0:1787862575.969982:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787862575.969988:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.969996:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44c00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862575.970000:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970008:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862575.970015:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862575.970022:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862575.970232:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970240:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787862575.970301:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526407936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862575.970337:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862575.970391:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970401:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af44c00/0x9c5536ccf892fd90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970417:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862575.970421:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970427:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862575.970437:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862575.970441:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526407936 00010000:00010000:3.0:1787862575.970446:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862575.970454:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526407936 10000000:00010000:3.0:1787862575.970457:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862575.970467:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862575.970494:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862575.970501:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 19 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970503:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862575.970523:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970532:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af45200/0x9c5536ccf892fd82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd89 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970547:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862575.970551:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862575.970571:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787862575.970573:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862575.970578:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862575.970588:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526407936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862575.970591:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862575.970609:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:3.0:1787862575.970620:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862575.970621:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 19 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862575.970634:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787862575.970651:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970657:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862575.970663:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970669:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6500030200/0x9c5536ccf892fd74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf892fd7b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.970684:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862575.970686:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862575.970687:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862575.970697:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862575.970720:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526408064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862575.970750:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862575.970773:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862575.970778:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526408192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862575.970800:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862575.970822:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862575.971183:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 19 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862575.971208:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500031800/0x9c5536ccf892fd97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fd90 expref: 19 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862575.971237:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862575.971317:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408064 00000100:00100000:3.0:1787862575.971324:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408064 00010000:00010000:3.0:1787862575.971419:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 19 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.971454:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408192 00000100:00100000:3.0:1787862575.971457:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408192 00010000:00010000:3.0:1787862575.971470:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 20 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.971484:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862575.971491:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+20:3283:x1874709526408064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862575.971503:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862575.971508:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 20 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.971520:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 20 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.971536:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500031c00/0x9c5536ccf892fd89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fd82 expref: 20 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.971551:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862575.971603:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526408064:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862575.971609:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862575.971624:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862575.971629:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3283:x1874709526408192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862575.971636:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862575.971640:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 18 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.971649:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 18 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.971666:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd000/0x9c5536ccf892fd7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf892fd74 expref: 18 pid: 5810 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.971682:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862575.971707:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3283:x1874709526408192:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862575.971713:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787862575.971754:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526408192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862575.971763:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526408064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862575.976413:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862575.976451:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933632 00000100:00100000:3.0:1787862575.976460:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933632 00010000:00010000:3.0:1787862575.976497:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 13 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.976537:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862575.976546:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516933632:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862575.976572:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862575.976577:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 13 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.976589:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 13 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862575.976609:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862575.976660:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516933632:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862575.976683:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00010000:00010000:2.0:1787862575.977116:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af44800/0x9c5536ccf892fd6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34647 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862575.977131:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400ab0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407680:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862575.977143:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1874709526407808:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862575.977173:0:11657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862575.977634:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862575.980287:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933760 00000100:00100000:2.0:1787862575.980304:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933760 00010000:00010000:2.0:1787862575.980354:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862575.980400:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:2.0:1787862575.980426:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:2346:x1874709516933760:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862575.980442:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862575.980448:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980461:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980479:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919600/0x9c5536ccf892fd66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34640 expref: 12 pid: 5809 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980498:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980506:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980522:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980529:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980536:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980543:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980549:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862575.980554:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980578:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980598:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980608:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862575.980665:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2346:x1874709516933760:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 240us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862575.980673:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00010000:00010000:2.0:1787862575.980708:0:11657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980716:0:11657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862575.980722:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd200/0x9c5536ccf892fecb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862575.981968:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3282:x1874709526407936:12345-0@lo:103:ldlm_bl.0 Request processed in 11372us (11615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862575.981989:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862575.983779:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526407936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862576.330241:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862576.330273:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862576.330312:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516933888 00000100:00100000:0.0:1787862576.330323:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516933888 00000100:00100000:3.0:1787862576.330339:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862576.330375:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862576.330375:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 259 00000100:00100000:0.0:1787862576.330384:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2349:x1874709516933888:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862576.330397:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934016 00000100:00100000:3.0:1787862576.330400:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934016 00000100:00100000:3.0:1787862576.330436:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934272 00000100:00100000:3.0:1787862576.330439:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934272 00000100:00100000:3.0:1787862576.330456:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:0.0:1787862576.330457:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2349:x1874709516933888:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862576.330463:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2349:x1874709516934016:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862576.330465:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 259 00000100:00100000:3.0:1787862576.330494:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2349:x1874709516934016:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862576.330500:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:3.0:1787862576.330512:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:3.0:1787862576.330518:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516934272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862576.330542:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516934272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862576.330548:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00080000:3.0:1787862576.330577:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862576.330881:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934144 00000100:00100000:1.0:1787862576.330886:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934144 00000100:00080000:3.0:1787862576.330919:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862576.330933:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:1.0:1787862576.330940:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2349:x1874709516934144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862576.330986:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2349:x1874709516934144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 47us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862576.330992:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00010000:00010000:0.0:1787862576.732698:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862576.796284:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526408320:0@lo:400:kworker.0 00000100:00100000:2.0:1787862576.796380:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862576.796659:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408320 00000100:00100000:3.0:1787862576.796667:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408320 00000100:00100000:3.0:1787862576.796723:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787862576.796735:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3281:x1874709526408320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862576.796917:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526408448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862576.796954:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862576.797348:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3281:x1874709526408320:12345-0@lo:400:kworker.0 Request processed in 614us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862576.797356:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787862576.797391:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408448 00000100:00100000:3.0:1787862576.797395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408448 00000100:00100000:3.0:1787862576.797421:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787862576.797428:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526408448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.797471:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526408448:12345-0@lo:400:kworker.0 Request processed in 43us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862576.797477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787862576.797523:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526408448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862576.797909:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526408704:0@lo:400:kworker.0 00000100:00100000:0.0:1787862576.797945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862576.797975:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862576.797982:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526408576:0@lo:400:kworker.0 00000100:00100000:0.0:1787862576.798005:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862576.798125:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408704 00000100:00100000:1.0:1787862576.798130:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408704 00000100:00100000:1.0:1787862576.798182:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787862576.798190:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526408704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862576.798233:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526408704:12345-0@lo:400:kworker.0 Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862576.798240:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787862576.798301:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862576.798322:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787862576.798327:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a653dc8bc00, transno 4294967300 00000100:00100000:0.0:1787862576.798345:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526408704:0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.798416:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408576 00000100:00100000:3.0:1787862576.798420:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408576 00000100:00100000:3.0:1787862576.798461:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787862576.798468:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526408576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.798503:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526408576:12345-0@lo:400:kworker.0 Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00080000:0.0:1787862576.798597:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862576.798631:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526408576:0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.798675:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787862576.798697:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526408960:0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.798723:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862576.798747:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862576.798753:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526408832:0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.798777:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862576.798800:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408832 00000100:00100000:3.0:1787862576.798804:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408832 00000100:00100000:3.0:1787862576.798829:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787862576.798842:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526408832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862576.798875:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526408832:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862576.798970:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526408960 00000100:00100000:0.0:1787862576.798974:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526408960 00000100:00100000:0.0:1787862576.799002:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862576.799008:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862576.799064:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526408960:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862576.799071:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787862576.799089:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862576.799091:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862576.799137:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787862576.799177:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526408832:0@lo:400:kworker.0 00010000:00080000:3.0:1787862576.799188:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a64031992c0 x1874709526408960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862576.799198:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526408960:0@lo:400:kworker.0 00000100:00100000:2.0:1787862576.799719:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526408320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862577.225223:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862577.225379:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934400 00000100:00100000:0.0:1787862577.225390:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934400 00000100:00100000:0.0:1787862577.225452:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 261 00000100:00100000:0.0:1787862577.225463:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:5592:x1874709516934400:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862577.225482:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862577.225501:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fed2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34694 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.225544:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34694 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.225565:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34694 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.225574:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919800, rc 0) 00000100:00100000:0.0:1787862577.225639:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516934400:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 178us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.225646:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 261 00000100:00100000:2.0:1787862577.232006:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862577.232321:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934528 00000100:00100000:3.0:1787862577.232335:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934528 00000100:00100000:3.0:1787862577.232395:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 262 00000100:00100000:3.0:1787862577.232405:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516934528:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862577.233262:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516934528:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 853us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862577.233274:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 262 00000100:00100000:1.0:1787862577.241860:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862577.241946:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934656 00000100:00100000:3.0:1787862577.241957:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934656 00000100:00100000:3.0:1787862577.242026:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 263 00000100:00100000:3.0:1787862577.242036:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516934656:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862577.242410:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516934656:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 374us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862577.242419:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 263 00000100:00100000:0.0:1787862577.254681:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862577.255014:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934784 00000100:00100000:3.0:1787862577.255039:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934784 00000100:00100000:3.0:1787862577.255137:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 264 00000100:00100000:3.0:1787862577.255147:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:9946:x1874709516934784:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862577.255417:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:9946:x1874709516934784:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 270us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862577.255426:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 264 00000100:00100000:2.0:1787862577.270609:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862577.270755:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516934912 00000100:00100000:0.0:1787862577.270766:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516934912 00000100:00100000:0.0:1787862577.270831:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 265 00000100:00100000:0.0:1787862577.270841:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:9946:x1874709516934912:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862577.271133:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:9946:x1874709516934912:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 293us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.271141:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 265 00000100:00100000:1.0:1787862577.281312:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862577.282217:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935040 00000100:00100000:0.0:1787862577.282229:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935040 00000100:00100000:0.0:1787862577.282295:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 266 00000100:00100000:0.0:1787862577.282305:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:5592:x1874709516935040:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862577.282321:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862577.282338:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fed9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b3469b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.282365:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3469b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.282376:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3469b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.282385:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918200, rc 0) 00000100:00100000:0.0:1787862577.282439:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516935040:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 137us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.282446:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 266 00000100:00100000:1.0:1787862577.290532:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862577.290829:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935168 00000100:00100000:3.0:1787862577.290840:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935168 00000100:00100000:3.0:1787862577.290894:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 267 00000100:00100000:3.0:1787862577.290904:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516935168:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862577.291459:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516935168:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 555us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862577.291468:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 267 00000100:00100000:2.0:1787862577.295320:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862577.295415:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935296 00000100:00100000:1.0:1787862577.295424:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935296 00000100:00100000:1.0:1787862577.295482:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 268 00000100:00100000:1.0:1787862577.295492:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516935296:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.295969:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:5592:x1874709516935296:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 477us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862577.295978:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 268 00000100:00100000:1.0:1787862577.301432:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862577.301785:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935424 00000100:00100000:3.0:1787862577.301809:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935424 00000100:00100000:3.0:1787862577.301870:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 269 00000100:00100000:3.0:1787862577.301880:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:9949:x1874709516935424:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862577.303629:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:9949:x1874709516935424:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 1743us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862577.303654:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 269 00000100:00100000:0.0:1787862577.308996:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862577.309036:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526409088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862577.309139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862577.309348:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409088 00000100:00100000:2.0:1787862577.309356:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409088 00000100:00100000:2.0:1787862577.309414:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862577.309423:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526409088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862577.309460:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862577.309507:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526409088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862577.309514:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787862577.310537:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e87840 x1874709526409088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862577.310583:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526409088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862577.327734:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862577.327828:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935552 00000100:00100000:0.0:1787862577.327837:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935552 00000100:00100000:0.0:1787862577.327885:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 270 00000100:00100000:0.0:1787862577.327895:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:9949:x1874709516935552:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787862577.328165:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:9949:x1874709516935552:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 270us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.328174:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 270 10000000:01000000:1.0:1787862577.756162:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862577.756171:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a651c992800 from 7 10000000:01000000:1.0:1787862577.756175:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862577.756223:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.756235:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.756247:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862577.756274:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.756354:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.756408:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65065980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862577.756597:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409216 00000100:00100000:2.0:1787862577.756604:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409216 00000100:00100000:2.0:1787862577.756658:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787862577.756667:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:5813:x1874709526409216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862577.756679:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862577.756692:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fee7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fee0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862577.756713:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fee0 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862577.756725:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fee0 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862577.756733:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd800, rc 0) 00000100:00100000:2.0:1787862577.756795:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526409216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862577.756817:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787862577.757287:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862577.757303:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.757313:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862577.757370:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.757399:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.757441:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65065980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862577.757494:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409344 00000100:00100000:0.0:1787862577.757498:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409344 00000100:00100000:0.0:1787862577.757540:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787862577.757556:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526409344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862577.758126:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526409344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 570us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.758134:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00010000:3.0:1787862577.758460:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862577.758513:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.758632:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.758673:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.758737:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65065980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862577.759085:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409472 00000100:00100000:0.0:1787862577.759090:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409472 00000100:00100000:0.0:1787862577.759170:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787862577.759179:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526409472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862577.759351:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526409472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.759359:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787862577.759432:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.759827:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11670:1874709526409600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.759867:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.760523:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65065980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862577.760710:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409600 00000100:00100000:2.0:1787862577.760716:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409600 00000100:00100000:2.0:1787862577.760894:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787862577.760904:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:11670:x1874709526409600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862577.761338:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:11670:x1874709526409600:12345-0@lo:502:llog_process_th.0 Request processed in 434us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862577.761346:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787862577.761482:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11670:1874709526409600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862577.761510:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862577.761520:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862577.761521:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787862577.761539:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a651c992800 00000020:00000080:1.0:1787862577.761550:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787862577.761633:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11670:1874709526409728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.761669:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.761690:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc25600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862577.761938:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409728 00000100:00100000:0.0:1787862577.761943:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409728 00000100:00100000:0.0:1787862577.761966:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787862577.761973:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:11670:x1874709526409728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862577.762131:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:11670:x1874709526409728:12345-0@lo:502:llog_process_th.0 Request processed in 157us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.762138:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787862577.764325:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11670:1874709526409728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862577.764370:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862577.764379:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862577.764381:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787862577.764385:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787862577.764646:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787862577.764668:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862577.764679:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.764690:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862577.764702:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862577.764704:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a653d6d2000 from 7 10000000:01000000:0.0:1787862577.764707:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862577.764756:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.764772:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.764782:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862577.764812:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc88f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862577.764873:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862577.764914:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509c31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862577.765160:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409856 00000100:00100000:1.0:1787862577.765167:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409856 00000100:00100000:1.0:1787862577.765202:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787862577.765220:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:5813:x1874709526409856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862577.765234:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862577.765246:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a654204f200/0x9c5536ccf892fef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892feee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.765269:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a654204f200/0x9c5536ccf892fef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892feee expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.765280:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a654204f200/0x9c5536ccf892fef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892feee expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.765289:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f200, rc 0) 00000100:00100000:1.0:1787862577.765333:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526409856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862577.765340:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787862577.765382:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc88f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862577.765394:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.765403:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862577.765450:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.765491:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.765506:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc25600 going to sleep for 11 seconds 00000100:00100000:1.0:1787862577.765517:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526409984 00000100:00100000:1.0:1787862577.765520:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526409984 00000100:00100000:1.0:1787862577.765536:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787862577.765562:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526409984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.765899:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526409984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862577.765906:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787862577.765935:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526409984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.765963:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.766094:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.766110:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509956e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862577.766123:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410112 00000100:00100000:1.0:1787862577.766126:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410112 00000100:00100000:1.0:1787862577.766144:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787862577.766150:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526410112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.766284:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526410112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862577.766290:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787862577.766320:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.766486:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11671:1874709526410240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.766518:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.766533:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410240 00000100:00100000:1.0:1787862577.766536:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410240 00000100:00100000:1.0:1787862577.766565:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787862577.766570:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:11671:x1874709526410240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.766675:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:11671:x1874709526410240:12345-0@lo:502:llog_process_th.0 Request processed in 104us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862577.766689:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787862577.766710:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65099563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862577.766720:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11671:1874709526410240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862577.766738:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862577.766747:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862577.766749:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787862577.766754:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a653d6d2000 00000020:00000080:1.0:1787862577.766756:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787862577.768206:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11671:1874709526410368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.768269:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.768294:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410368 00000100:00100000:1.0:1787862577.768298:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410368 00000100:00100000:1.0:1787862577.768324:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787862577.768330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:11671:x1874709526410368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.768496:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:11671:x1874709526410368:12345-0@lo:502:llog_process_th.0 Request processed in 166us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862577.768503:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787862577.768615:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65099563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862577.768631:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11671:1874709526410368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862577.768651:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862577.768657:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862577.768659:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787862577.768662:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787862577.768712:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787862577.768728:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787862577.768736:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.771244:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862577.771257:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787862577.771260:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a65091a1800 from 7 10000000:01000000:1.0:1787862577.771263:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787862577.771300:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.771308:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.771318:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862577.771344:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.771405:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.771451:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65099563c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862577.771522:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410496 00000100:00100000:3.0:1787862577.771529:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410496 00000100:00100000:3.0:1787862577.771612:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787862577.771622:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:5813:x1874709526410496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862577.771635:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862577.771647:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6501684600/0x9c5536ccf892ff03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf892fefc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862577.771684:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6501684600/0x9c5536ccf892ff03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf892fefc expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862577.771695:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6501684600/0x9c5536ccf892ff03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf892fefc expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862577.771704:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6501684600, rc 0) 00000100:00100000:3.0:1787862577.771756:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526410496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862577.772244:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787862577.772662:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862577.772681:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862577.772691:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862577.772945:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.773909:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.773964:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65099563c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862577.774172:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410624 00000100:00100000:3.0:1787862577.774179:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410624 00000100:00100000:3.0:1787862577.774216:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787862577.774225:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526410624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862577.774497:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526410624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862577.774504:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787862577.774647:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.774686:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.774725:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.774900:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65099563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862577.780379:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410752 00000100:00100000:0.0:1787862577.780395:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410752 00000100:00100000:0.0:1787862577.780488:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787862577.780499:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526410752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862577.780779:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:5813:x1874709526410752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.780787:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787862577.780887:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43a6d3ac-1408-47c4-9e06-195b8e037a27:5813:1874709526410752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862577.781163:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11674:1874709526410880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787862577.781211:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862577.788102:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509956a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862577.792426:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526410880 00000100:00100000:0.0:1787862577.792439:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526410880 00000100:00100000:0.0:1787862577.792479:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787862577.792490:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:11674:x1874709526410880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862577.792774:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:11674:x1874709526410880:12345-0@lo:502:llog_process_th.0 Request processed in 285us (11562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.792781:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000040:00080000:3.0:1787862577.793712:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787862577.794666:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11674:1874709526410880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862577.794707:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862577.794718:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862577.794721:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787862577.794728:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a65091a1800 00000020:00000080:0.0:1787862577.794732:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787862577.795142:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11674:1874709526411008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862577.795227:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862577.795252:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509956a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862577.795271:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411008 00000100:00100000:0.0:1787862577.795276:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411008 00000100:00100000:0.0:1787862577.795308:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787862577.795317:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:11674:x1874709526411008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862577.795534:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:11674:x1874709526411008:12345-0@lo:502:llog_process_th.0 Request processed in 216us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862577.795552:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787862577.795605:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43a6d3ac-1408-47c4-9e06-195b8e037a27:11674:1874709526411008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862577.795626:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862577.795632:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862577.795633:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787862577.795637:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787862577.796513:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787862577.796534:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862577.796552:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862577.796564:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862578.785784:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862578.844868:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787862578.845585:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526411136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862578.845679:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862578.845841:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411136 00000100:00100000:2.0:1787862578.845849:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411136 00000100:00100000:2.0:1787862578.845916:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862578.845928:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526411136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862578.845978:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862578.846024:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526411136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862578.846033:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787862578.846154:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526411136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862578.846360:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862579.804317:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862580.828340:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862581.460628:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862581.460680:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862581.460725:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862581.460768:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862581.460812:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935936 00000100:00100000:1.0:1787862581.460822:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935936 00000100:00100000:2.0:1787862581.461032:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935680 00000100:00100000:2.0:1787862581.461036:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935680 00000100:00100000:2.0:1787862581.461086:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 286 00000100:00100000:2.0:1787862581.461096:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516935680:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862581.461165:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516935680:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 71us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862581.461173:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 286 00000100:00080000:2.0:1787862581.461349:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862581.461702:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516935808 00000100:00100000:0.0:1787862581.461709:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516935808 00000100:00100000:0.0:1787862581.461759:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936064 00000100:00100000:0.0:1787862581.461763:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936064 00000100:00100000:0.0:1787862581.461787:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:0.0:1787862581.461795:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516935808:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862581.461857:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516935808:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 62us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862581.461865:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:0.0:1787862581.461879:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 128 00000100:00100000:0.0:1787862581.461886:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516936064:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862581.461922:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516936064:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 37us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862581.461961:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 128 00000100:00100000:0.0:1787862581.462000:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:0.0:1787862581.462008:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516935936:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862581.462036:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516935936:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862581.462064:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00080000:2.0:1787862581.462781:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787862581.852737:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862581.916740:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526411648:0@lo:400:kworker.0 00000100:00100000:0.0:1787862581.916820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862581.916885:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862581.916893:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526411520:0@lo:400:kworker.0 00000100:00100000:0.0:1787862581.916921:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862581.916954:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411648 00000100:00100000:0.0:1787862581.916961:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411648 00000100:00100000:0.0:1787862581.917072:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787862581.917083:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526411648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862581.917138:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526411648:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862581.917144:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787862581.917165:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862581.917196:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526411648:0@lo:400:kworker.0 00000100:00100000:0.0:1787862581.917236:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411520 00000100:00100000:0.0:1787862581.917239:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411520 00000100:00100000:0.0:1787862581.917270:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787862581.917277:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526411520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862581.917312:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526411520:12345-0@lo:400:kworker.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00080000:1.0:1787862581.917572:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862581.917598:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526411520:0@lo:400:kworker.0 00000100:00100000:0.0:1787862581.917652:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787862581.917767:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526411392:0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.917798:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862581.917827:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526411904:0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.917850:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862581.917880:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787862581.917887:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526411264:0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.917914:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862581.917934:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526411776:0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.917955:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862581.918025:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411392 00000100:00100000:3.0:1787862581.918029:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411392 00000100:00100000:3.0:1787862581.918082:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411776 00000100:00100000:3.0:1787862581.918086:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411776 00000100:00100000:3.0:1787862581.918109:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787862581.918115:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.918153:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526411392:12345-0@lo:400:kworker.0 Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862581.918159:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787862581.918175:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787862581.918182:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526411776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.918207:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526411776:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862581.918213:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787862581.918259:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526411776:0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.918271:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526411392:0@lo:400:kworker.0 00000100:00080000:3.0:1787862581.918287:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862581.918296:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411904 00000100:00100000:3.0:1787862581.918299:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411904 00000100:00100000:3.0:1787862581.918339:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787862581.918346:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526411904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862581.918389:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526411904:12345-0@lo:400:kworker.0 Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862581.918396:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787862581.918410:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787862581.918431:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a653dc892c0 x1874709526411904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862581.918441:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526411904:0@lo:400:kworker.0 00000100:00100000:1.0:1787862581.918685:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526411264 00000100:00100000:1.0:1787862581.918689:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526411264 00000100:00100000:1.0:1787862581.918727:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787862581.918734:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862581.918768:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526411264:12345-0@lo:400:kworker.0 Request processed in 36us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862581.918780:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787862581.918956:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526411264:0@lo:400:kworker.0 00000100:00100000:3.0:1787862582.428458:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526412032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862582.428549:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862582.428923:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412032 00000100:00100000:2.0:1787862582.428945:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412032 00000100:00100000:2.0:1787862582.429007:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862582.429017:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526412032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862582.429076:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862582.429131:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526412032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862582.429138:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787862582.429343:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e86d00 x1874709526412032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862582.429364:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526412032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862582.878823:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862583.901327:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862583.965378:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862583.965404:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526412160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862583.965483:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862583.965617:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412160 00000100:00100000:2.0:1787862583.965626:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412160 00000100:00100000:2.0:1787862583.965701:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862583.965713:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526412160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862583.965752:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862583.965802:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526412160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862583.965809:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787862583.966025:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862583.966110:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526412160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862584.925082:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862585.948414:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862586.573266:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862586.573326:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862586.573327:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936192 00000100:00100000:3.0:1787862586.573336:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936192 00000100:00100000:1.0:1787862586.573347:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862586.573396:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 288 00000100:00100000:3.0:1787862586.573407:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516936192:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862586.573500:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936320 00000100:00100000:0.0:1787862586.573505:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936320 00000100:00100000:0.0:1787862586.573544:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936576 00000100:00100000:0.0:1787862586.573547:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936576 00000100:00100000:0.0:1787862586.573571:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:0.0:1787862586.573578:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516936320:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862586.573691:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653a95e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516936192:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 285us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862586.573699:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 288 00000100:00100000:3.0:1787862586.573731:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:3.0:1787862586.573752:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516936576:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862586.582269:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516936320:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 8675us (8925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862586.582293:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00080000:0.0:1787862586.582355:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862586.589732:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862586.590141:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936448 00000100:00100000:0.0:1787862586.590151:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936448 00000100:00100000:0.0:1787862586.590236:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:0.0:1787862586.590248:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516936448:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862586.590327:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516936448:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 82us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862586.590336:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00080000:1.0:1787862586.590611:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862586.594924:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516936576:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 21159us (21561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862586.594940:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00010000:00010000:2.0:1787862586.974793:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862587.036492:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526412544:0@lo:400:kworker.0 00000100:00100000:1.0:1787862587.036576:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862587.036644:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862587.036651:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526412672:0@lo:400:kworker.0 00000100:00100000:1.0:1787862587.036690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862587.036726:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412672 00000100:00100000:1.0:1787862587.036733:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412672 00000100:00100000:1.0:1787862587.036792:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862587.036802:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526412672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862587.036856:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526412672:12345-0@lo:400:kworker.0 Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862587.036864:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787862587.036885:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862587.036913:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526412672:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037090:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526412416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037123:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862587.037149:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526412928:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037171:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862587.037192:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787862587.037198:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526412288:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037241:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862587.037265:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526412800:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037288:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862587.037318:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412544 00000100:00100000:0.0:1787862587.037322:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412544 00000100:00100000:0.0:1787862587.037355:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412416 00000100:00100000:0.0:1787862587.037358:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412416 00000100:00100000:0.0:1787862587.037368:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412800 00000100:00100000:0.0:1787862587.037370:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412800 00000100:00100000:0.0:1787862587.037381:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787862587.037386:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526412544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037421:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526412544:12345-0@lo:400:kworker.0 Request processed in 34us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862587.037427:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787862587.037438:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787862587.037443:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037491:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526412416:12345-0@lo:400:kworker.0 Request processed in 47us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862587.037497:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787862587.037509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787862587.037515:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526412800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037540:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526412800:12345-0@lo:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862587.037546:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787862587.037563:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412928 00000100:00100000:0.0:1787862587.037567:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412928 00000100:00100000:0.0:1787862587.037592:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862587.037608:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526412928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037640:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526412928:12345-0@lo:400:kworker.0 Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862587.037645:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787862587.037676:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526412288 00000100:00100000:0.0:1787862587.037680:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526412288 00000100:00100000:0.0:1787862587.037706:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787862587.037712:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526412288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037743:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526412288:12345-0@lo:400:kworker.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862587.037748:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:0.0:1787862587.037780:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862587.037784:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862587.037804:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526412288:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037815:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526412800:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037824:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526412416:0@lo:400:kworker.0 00010000:00080000:0.0:1787862587.037835:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e0b0c0 x1874709526412928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862587.037845:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526412928:0@lo:400:kworker.0 00000100:00100000:0.0:1787862587.037881:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526412544:0@lo:400:kworker.0 00000100:00100000:3.0:1787862587.552842:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862587.552870:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526413056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862587.552947:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862587.554012:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413056 00000100:00100000:2.0:1787862587.554025:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413056 00000100:00100000:2.0:1787862587.554126:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862587.554136:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526413056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862587.554184:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862587.554259:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526413056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862587.554266:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787862587.554349:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e86940 x1874709526413056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862587.554371:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526413056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862587.996199:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862588.062030:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787862589.020287:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862589.084492:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862589.084527:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862589.084629:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862589.084817:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413184 00000100:00100000:2.0:1787862589.084826:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413184 00000100:00100000:2.0:1787862589.084904:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787862589.084916:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526413184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862589.084958:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862589.085011:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526413184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862589.085019:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862589.085415:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526413184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862589.085451:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862590.046281:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862591.069189:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862591.698263:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862591.698326:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862591.698676:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936704 00000100:00100000:3.0:1787862591.698686:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936704 00000100:00100000:3.0:1787862591.698749:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 290 00000100:00100000:3.0:1787862591.698759:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516936704:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862591.698849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516936704:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 91us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862591.698857:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 290 00000100:00100000:3.0:1787862591.702796:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862591.702931:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862591.703008:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936960 00000100:00100000:0.0:1787862591.703022:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936960 00000100:00100000:0.0:1787862591.703169:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:0.0:1787862591.703180:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2345:x1874709516936960:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:0.0:1787862591.703229:0:6672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fe3f 00000100:00080000:0.0:1787862591.703241:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9a6537e6a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787862591.703300:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787862591.704437:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+2:2345:x1874709516936960:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 1249us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862591.704455:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00010000:00010000:0.0:1787862591.704505:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787862591.704865:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862591.710999:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516936832 00000100:00100000:1.0:1787862591.711065:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516936832 00000100:00100000:1.0:1787862591.711152:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937088 00000100:00100000:1.0:1787862591.711156:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937088 00000100:00100000:1.0:1787862591.711190:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:1.0:1787862591.711202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2349:x1874709516936832:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862591.711302:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:1.0:1787862591.711314:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2349:x1874709516936832:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 111us (12984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862591.711328:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:3.0:1787862591.711329:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516937088:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862591.711403:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516937088:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 89us (8471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862591.711436:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00080000:2.0:1787862591.711816:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862592.093561:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862592.161249:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526413696:0@lo:400:kworker.0 00000100:00100000:0.0:1787862592.161356:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862592.161466:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862592.161472:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526413568:0@lo:400:kworker.0 00000100:00100000:0.0:1787862592.161501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862592.161538:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413696 00000100:00100000:0.0:1787862592.161548:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413696 00000100:00100000:0.0:1787862592.161622:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862592.161634:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526413696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787862592.161858:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862592.162011:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526413440:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162077:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862592.162100:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526413952:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162122:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862592.162143:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787862592.162148:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526413312:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162181:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862592.162206:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526413824:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162235:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862592.162263:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413568 00000100:00100000:1.0:1787862592.162267:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413568 00000100:00100000:1.0:1787862592.162303:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413440 00000100:00100000:1.0:1787862592.162305:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413440 00000100:00100000:1.0:1787862592.162316:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413824 00000100:00100000:1.0:1787862592.162317:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413824 00000100:00100000:1.0:1787862592.162330:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787862592.162336:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526413568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162397:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526413568:12345-0@lo:400:kworker.0 Request processed in 61us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862592.162436:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787862592.162457:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787862592.162462:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526413440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162497:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526413440:12345-0@lo:400:kworker.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862592.162504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787862592.162514:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787862592.162520:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526413824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162545:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526413824:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862592.162550:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787862592.162570:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413312 00000100:00100000:1.0:1787862592.162573:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413312 00000100:00100000:1.0:1787862592.162599:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787862592.162606:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526413312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162638:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526413312:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862592.162644:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:1.0:1787862592.162694:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862592.162728:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526413312:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162744:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526413824:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162752:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526413440:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162792:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526413568:0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.162838:0:6671:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787862592.163080:0:6671:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787862592.163250:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526413952 00000100:00100000:1.0:1787862592.163256:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526413952 00000100:00100000:1.0:1787862592.163289:0:6671:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787862592.163299:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787862592.163307:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862592.163358:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526413952:12345-0@lo:400:kworker.0 Request processed in 53us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862592.163364:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787862592.163380:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787862592.163403:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a651fae9a40 x1874709526413952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862592.163503:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526413952:0@lo:400:kworker.0 00000100:00100000:0.0:1787862592.164030:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526413696:12345-0@lo:400:kworker.0 Request processed in 2397us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862592.164038:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787862592.164427:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526413696:0@lo:400:kworker.0 00000100:00100000:3.0:1787862592.668868:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526414080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862592.668971:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862592.669148:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414080 00000100:00100000:2.0:1787862592.669159:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414080 00000100:00100000:2.0:1787862592.669239:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787862592.669251:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526414080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862592.669303:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862592.669373:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526414080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862592.669380:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787862592.669511:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e84f00 x1874709526414080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862592.669533:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526414080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862593.118925:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862594.140276:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862594.204453:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862594.204486:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526414208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862594.204598:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862594.204823:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414208 00000100:00100000:2.0:1787862594.204833:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414208 00000100:00100000:2.0:1787862594.204922:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862594.204937:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526414208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862594.204993:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787862594.204996:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862594.205089:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526414208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862594.205098:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862594.205275:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526414208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862595.164523:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787862595.329108:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:0.0:1787862595.329126:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a6537e6a800/21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:3.0:1787862595.329593:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537e6a800/21567a16-68b5-41a8-a3f6-27f314a231da for lustre-OST0000 00000020:00000080:3.0:1787862595.329678:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6537e6a000 for lustre-OST0000 00010000:00010000:0.0:1787862596.189774:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862596.814887:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862596.816016:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862596.816720:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862596.817732:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937216 00000100:00100000:1.0:1787862596.817748:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937216 00000100:00100000:1.0:1787862596.819113:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 292 00000100:00100000:1.0:1787862596.819128:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516937216:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862596.819187:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937472 00000100:00100000:2.0:1787862596.819196:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937472 00000100:00100000:1.0:1787862596.819252:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709516937216:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 127us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862596.819262:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 292 00000100:00100000:2.0:1787862596.819284:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937344 00000100:00100000:2.0:1787862596.819289:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937344 00000100:00100000:2.0:1787862596.819340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 142 00000100:00100000:2.0:1787862596.819349:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516937472:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862596.819395:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516937472:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 48us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862596.819401:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 142 00000100:00100000:2.0:1787862596.819416:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00100000:2.0:1787862596.819423:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516937344:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862596.819451:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516937344:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862596.819457:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00080000:1.0:1787862596.819745:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862597.213344:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862597.282439:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526414336:0@lo:400:kworker.0 00000100:00100000:2.0:1787862597.282540:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862597.282703:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414336 00000100:00100000:0.0:1787862597.282712:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414336 00000100:00100000:0.0:1787862597.282776:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787862597.282786:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526414336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.286916:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526414336:12345-0@lo:400:kworker.0 Request processed in 4112us (4357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862597.286935:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787862597.287445:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511543c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526414464:0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.287519:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862597.287824:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862597.287836:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526414592:0@lo:400:kworker.0 00000100:00100000:3.0:1787862597.287867:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862597.288008:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414464 00000100:00100000:3.0:1787862597.288015:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414464 00000100:00100000:3.0:1787862597.288159:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414592 00000100:00100000:3.0:1787862597.288163:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414592 00000100:00100000:3.0:1787862597.288200:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787862597.288209:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526414464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862597.288270:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526414464:12345-0@lo:400:kworker.0 Request processed in 62us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862597.288277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787862597.288291:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787862597.288299:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526414592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862597.288331:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526414592:12345-0@lo:400:kworker.0 Request processed in 34us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862597.288337:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787862597.288355:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862597.288413:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526414592:0@lo:400:kworker.0 00000100:00100000:3.0:1787862597.288470:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526414720:0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.289660:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511543c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526414464:0@lo:400:kworker.0 00000100:00100000:3.0:1787862597.289860:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862597.289983:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414720 00000100:00100000:0.0:1787862597.289995:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414720 00000100:00100000:0.0:1787862597.290073:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787862597.290080:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511541a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526414720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.290130:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511541a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526414720:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862597.290136:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787862597.290154:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862597.290273:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526414720:0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.291031:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526414976:0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.291318:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862597.291349:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862597.291356:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526414848:0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.291393:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862597.291426:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414848 00000100:00100000:0.0:1787862597.291431:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414848 00000100:00100000:0.0:1787862597.291474:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787862597.291481:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526414848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862597.291638:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526414336:0@lo:400:kworker.0 00000100:00100000:0.0:1787862597.291859:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526414848:12345-0@lo:400:kworker.0 Request processed in 377us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862597.291868:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1787862597.291887:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862597.292214:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526414976 00000100:00100000:3.0:1787862597.292219:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526414976 00000100:00100000:3.0:1787862597.292260:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862597.292268:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511602940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526414976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862597.292312:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511602940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526414976:12345-0@lo:400:kworker.0 Request processed in 45us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862597.292319:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787862597.292386:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526414848:0@lo:400:kworker.0 00010000:00080000:0.0:1787862597.292402:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6511543480 x1874709526414976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862597.292413:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526414976:0@lo:400:kworker.0 00000100:00080000:2.0:1787862597.292480:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862597.788894:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526415104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862597.788987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862597.789072:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415104 00000100:00100000:3.0:1787862597.789081:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415104 00000100:00100000:3.0:1787862597.789132:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862597.789145:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511602d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526415104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862597.789183:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862597.789252:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511602d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526415104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862597.789260:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787862597.789467:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e85680 x1874709526415104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862597.789499:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526415104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862598.238946:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862598.302973:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787862599.260221:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862599.327467:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526415232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862599.327545:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862599.327628:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415232 00000100:00100000:1.0:1787862599.327635:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415232 00000100:00100000:1.0:1787862599.327688:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862599.327699:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526415232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862599.327737:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862599.327781:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526415232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862599.327787:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787862599.327808:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862599.327847:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526415232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862600.292087:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787862601.274574:0:11837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:29:59 (1787862599) 00010000:00010000:0.0:1787862601.319389:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862601.940229:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862601.940306:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862601.940355:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862601.940592:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937600 00000100:00100000:0.0:1787862601.940605:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937600 00000100:00100000:0.0:1787862601.940700:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 294 00000100:00100000:0.0:1787862601.940712:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516937600:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862601.940815:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516937600:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 105us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862601.940823:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 294 00000100:00100000:1.0:1787862601.941330:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937728 00000100:00100000:1.0:1787862601.941337:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937728 00000100:00100000:1.0:1787862601.941399:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937856 00000100:00100000:1.0:1787862601.941402:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937856 00000100:00100000:1.0:1787862601.941429:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:1.0:1787862601.941447:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516937728:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862601.941498:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516937728:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 62us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862601.941504:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:1.0:1787862601.941518:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00100000:1.0:1787862601.941524:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516937856:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862601.941570:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516937856:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 47us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862601.941577:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00080000:2.0:1787862601.941882:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862602.333410:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862602.398603:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526415616:0@lo:400:kworker.0 00000100:00100000:2.0:1787862602.398610:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526415744:0@lo:400:kworker.0 00000100:00100000:3.0:1787862602.398728:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526415488:0@lo:400:kworker.0 00000100:00100000:0.0:1787862602.398738:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526415360:0@lo:400:kworker.0 00000100:00100000:2.0:1787862602.398924:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862602.399034:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415744 00000100:00100000:2.0:1787862602.399070:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415744 00000100:00100000:2.0:1787862602.399147:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862602.399159:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526415744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862602.399987:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526415744:12345-0@lo:400:kworker.0 Request processed in 829us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862602.399998:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787862602.400074:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862602.400125:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526415744:0@lo:400:kworker.0 00000100:00100000:3.0:1787862602.407127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862602.407195:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415488 00000100:00100000:1.0:1787862602.407209:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415488 00000100:00100000:3.0:1787862602.407243:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526416000:0@lo:400:kworker.0 00000100:00100000:1.0:1787862602.407295:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787862602.407320:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862602.407328:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511541e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526415488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862602.407403:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526416000 00000100:00100000:3.0:1787862602.407409:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526416000 00000100:00100000:1.0:1787862602.407413:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511541e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526415488:12345-0@lo:400:kworker.0 Request processed in 107us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862602.407423:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787862602.407462:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862602.407471:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511540780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526416000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787862602.407493:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862602.407516:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511540780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526416000:12345-0@lo:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862602.407524:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862602.407595:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526415488:0@lo:400:kworker.0 00010000:00080000:3.0:1787862602.407614:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e0b0c0 x1874709526416000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787862618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862602.407627:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526416000:0@lo:400:kworker.0 00000100:00100000:0.0:1787862602.410938:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862602.411225:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415360 00000100:00100000:1.0:1787862602.411238:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415360 00000100:00100000:1.0:1787862602.411477:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787862602.411490:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526415360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862602.411592:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526415360:12345-0@lo:400:kworker.0 Request processed in 104us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862602.411601:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787862602.411833:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862602.412126:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415616 00000100:00100000:1.0:1787862602.412133:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415616 00000100:00100000:1.0:1787862602.412192:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787862602.412200:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526415616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862602.412247:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526415616:12345-0@lo:400:kworker.0 Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862602.412288:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787862602.412429:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862602.412562:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526415360:0@lo:400:kworker.0 00000100:00100000:0.0:1787862602.412578:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526415872:0@lo:400:kworker.0 00000100:00100000:0.0:1787862602.412617:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862602.412729:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526415616:0@lo:400:kworker.0 00000100:00100000:1.0:1787862602.413201:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526415872 00000100:00100000:1.0:1787862602.413208:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526415872 00000100:00100000:1.0:1787862602.413362:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787862602.413374:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511602580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526415872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862602.413438:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511602580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526415872:12345-0@lo:400:kworker.0 Request processed in 67us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862602.413445:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787862602.413568:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526415872:0@lo:400:kworker.0 00000100:00080000:2.0:1787862602.413888:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862602.908603:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526416128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862602.908731:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862602.910001:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526416128 00000100:00100000:1.0:1787862602.910017:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526416128 00000100:00100000:1.0:1787862602.910119:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787862602.910132:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526416128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862602.910189:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862602.910298:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526416128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862602.910317:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787862602.910340:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6537e86580 x1874709526416128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862602.910366:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526416128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862603.366591:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862603.627565:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862603.627854:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516937984 00000100:00100000:1.0:1787862603.627868:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516937984 00000100:00100000:1.0:1787862603.627968:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:1.0:1787862603.627985:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+5:10218:x1874709516937984:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862603.628021:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862603.628287:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892ff0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346a2 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862603.628418:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892ff11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862603.628457:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862603.628475:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787862603.628479:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787862603.628712:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787862603.628718:0:7147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862603.628876:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862603.628920:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892ff0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346a2 expref: 7 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862603.628949:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892ff11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346a2 expref: 6 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862603.628959:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880700) 00010000:00010000:1.0:1787862603.628962:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862603.628966:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ee00, rc 0) 00000100:00100000:1.0:1787862603.629107:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:10218:x1874709516937984:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1063us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862603.629118:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:1.0:1787862603.646408:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862603.646568:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516938112 00000100:00100000:2.0:1787862603.646584:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516938112 00000100:00100000:2.0:1787862603.646677:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:2.0:1787862603.646691:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:10220:x1874709516938112:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862603.646726:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862603.646756:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346a9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.646848:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.646868:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.646883:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.646928:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.646937:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.646945:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.647805:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf892ff2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.647823:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf892ff2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.647832:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf892ff2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862603.647934:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787862603.647940:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862603.648180:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf892ff2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648196:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648204:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648211:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648230:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862603.648235:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648244:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648261:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880700) 00010000:00010000:2.0:1787862603.648264:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862603.648270:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648277:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ff1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648293:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648309:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648315:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648319:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862603.648322:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648328:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648350:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862603.648353:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862603.648357:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648363:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648420:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346a9 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648438:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf892ff2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346a9 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862603.648614:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862603.648618:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862603.648621:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc400, rc 0) 00000100:00100000:2.0:1787862603.648731:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:10220:x1874709516938112:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 2043us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862603.648742:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:0.0:1787862603.669020:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862603.669270:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516938368 00000100:00100000:3.0:1787862603.669283:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516938368 00000100:00100000:3.0:1787862603.669374:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:3.0:1787862603.669387:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:10220:x1874709516938368:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862603.669415:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862603.669442:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892ff34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346b0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.669563:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.669583:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.669604:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.669636:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.669644:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.669651:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.671103:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf892ff49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.671131:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf892ff49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.671142:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf892ff49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862603.672644:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787862603.673126:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673139:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673147:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673153:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501685600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862603.673158:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673180:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673199:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:3.0:1787862603.673202:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862603.673208:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673214:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501685600/0x9c5536ccf892ff3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673236:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673241:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673247:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673252:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501684400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862603.673255:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673260:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673267:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6517c53700) 00010000:00010000:3.0:1787862603.673269:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862603.673272:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.673288:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684400/0x9c5536ccf892ff42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.675701:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6501684a00/0x9c5536ccf892ff34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346b0 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.675737:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf892ff49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346b0 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862603.675747:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:3.0:1787862603.675750:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862603.675754:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422dc00, rc 0) 00000100:00100000:3.0:1787862603.675868:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:10220:x1874709516938368:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 6483us (6876us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787862603.675880:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:3.0:1787862603.689424:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862603.690178:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516938496 00000100:00100000:0.0:1787862603.690193:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516938496 00000100:00100000:0.0:1787862603.690369:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1787862603.690383:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511540f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:10220:x1874709516938496:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787862603.690702:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511540f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:10220:x1874709516938496:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 Request processed in 321us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862603.690712:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00010000:00010000:3.0:1787862604.386602:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862604.444336:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526416256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862604.444458:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862604.444895:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526416256 00000100:00100000:1.0:1787862604.444906:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526416256 00000100:00100000:1.0:1787862604.444994:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787862604.445010:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c2ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526416256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862604.445104:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862604.445176:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c2ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526416256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862604.445186:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787862604.445569:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862604.445639:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526416256:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787862604.456910:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1787862605.065673:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1787862605.404337:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862606.440373:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862606.476464:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862606.476585:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516938624 00000100:00100000:2.0:1787862606.476601:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516938624 00000100:00100000:2.0:1787862606.476713:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:2.0:1787862606.476730:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:10262:x1874709516938624:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862606.476759:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862606.476789:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892ff57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346b7 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.476905:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.476924:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.476940:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.476958:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.476966:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.476986:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477337:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477346:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477354:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477361:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862606.477366:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477386:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477402:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880700) 00010000:00010000:2.0:1787862606.477406:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862606.477413:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477420:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ff5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477449:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477456:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477462:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477468:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862606.477471:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477476:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477484:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6507fe6000) 00010000:00010000:2.0:1787862606.477487:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862606.477489:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477505:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ff65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477546:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892ff57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346b7 expref: 9 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477557:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880700) 00010000:00010000:2.0:1787862606.477560:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862606.477563:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892ff57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346b7 expref: 9 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.477575:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787862606.477667:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:10262:x1874709516938624:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 943us (1232us total) trans 0 rc 301/301 00000100:00100000:2.0:1787862606.477676:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00080000:3.0:1787862606.478432:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862606.489070:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862606.489336:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516938880 00000100:00100000:2.0:1787862606.489350:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516938880 00000100:00100000:2.0:1787862606.491014:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:2.0:1787862606.491056:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:10262:x1874709516938880:12345-192.168.202.60@tcp:36:lfs.0 00010000:00010000:2.0:1787862606.491141:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862606.491178:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf892ff11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346a2 expref: 8 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.491205:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880700) 00010000:00010000:2.0:1787862606.491220:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862606.491748:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.491777:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.491792:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.491809:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.491816:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.491824:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862606.504343:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787862606.504369:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.504383:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.504394:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.504401:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862606.504408:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.504417:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.504466:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862606.504470:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862606.504477:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.504484:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf892ff6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862606.504507:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a89d4a6 reply state 000000000f07a970 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862606.504518:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862606.504748:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:10262:x1874709516938880:12345-192.168.202.60@tcp:36:lfs.0 Request processed in 13712us (15710us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787862606.504760:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00010000:00010000:3.0:1787862606.526129:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.526305:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.526331:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.526339:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862606.526346:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.526356:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.526379:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6507fe6f00) 00010000:00010000:3.0:1787862606.526383:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862606.526388:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.526395:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf892ff73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862606.644393:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862606.644458:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939008 00000100:00100000:1.0:1787862606.644469:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939008 00000100:00100000:1.0:1787862606.644538:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:1.0:1787862606.644550:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:10270:x1874709516939008:12345-192.168.202.60@tcp:101:lctl.0 00010000:00010000:1.0:1787862606.644584:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862606.644614:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892ff7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346be expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.644702:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf892ff81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.644719:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf892ff81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.644733:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf892ff81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862606.644810:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787862606.644814:0:7147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862606.644870:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf892ff81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.644912:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892ff7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346be expref: 10 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.644932:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf892ff81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346be expref: 9 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.644942:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:1.0:1787862606.644945:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862606.644950:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ea00, rc 0) 00000100:00100000:1.0:1787862606.645243:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:10270:x1874709516939008:12345-192.168.202.60@tcp:101:lctl.0 Request processed in 694us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862606.645250:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:2.0:1787862606.686508:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862606.686818:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939136 00000100:00100000:1.0:1787862606.686833:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939136 00000100:00100000:1.0:1787862606.686952:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787862606.686966:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:10276:x1874709516939136:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862606.687007:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862606.687038:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892ff88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346c5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687193:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687214:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687229:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687267:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687287:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687295:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687862:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892ff9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687876:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.687886:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862606.687932:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787862606.687937:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862606.687995:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688013:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688020:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688028:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688090:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862606.688096:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688105:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688121:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:1.0:1787862606.688124:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862606.688140:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688147:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ff8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688164:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688170:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688177:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688182:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862606.688185:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688191:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688213:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6516880200) 00010000:00010000:1.0:1787862606.688216:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862606.688220:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688226:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892ff96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688281:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf892ff88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346c5 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688298:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892ff9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346c5 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.688307:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862606.688310:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787862606.688312:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204e800, rc 0) 00000100:00100000:3.0:1787862606.688999:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+10:10276:x1874709516939136:12345-192.168.202.60@tcp:101:bash.0 Request processed in 2029us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862606.689010:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787862606.691718:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862606.691841:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939392 00000100:00100000:2.0:1787862606.691854:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939392 00000100:00100000:2.0:1787862606.691956:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:2.0:1787862606.691969:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+10:10276:x1874709516939392:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862606.691998:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862606.692028:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892ffa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346cc expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.692282:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.692302:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.692335:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.693318:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.693345:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.693358:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862606.696173:0:7147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787862606.696428:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.696445:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.696458:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697030:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697064:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697074:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697083:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862606.697101:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697109:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697123:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862606.697126:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862606.697132:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697138:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862606.697153:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5f00fd9 reply state 000000007fa72dc0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862606.697162:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787862606.697204:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf892ffa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 13 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697219:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 12 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.697227:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:2.0:1787862606.697229:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862606.697232:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:2.0:1787862606.697334:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+13:10276:x1874709516939392:12345-192.168.202.60@tcp:101:bash.0 Request processed in 5367us (5631us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787862606.697343:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:1.0:1787862606.705780:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:0.0:1787862606.706631:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.706654:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.706662:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.706670:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862606.706674:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.706682:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.706699:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6507fe6200) 00010000:00010000:0.0:1787862606.706702:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862606.706707:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.706714:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf892ffb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862606.706901:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939520 00000100:00100000:2.0:1787862606.706911:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939520 00000100:00100000:2.0:1787862606.706966:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787862606.706975:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874709516939520:12345-192.168.202.60@tcp:8:bash.0 00010000:00080000:2.0:1787862606.707009:0:6671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:2.0:1787862606.707088:0:6671:0:(genops.c:1385:class_connect()) connect: client 21567a16-68b5-41a8-a3f6-27f314a231da, cookie 0x9c5536ccf892ffc7 00002000:00100000:2.0:1787862606.707101:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 21567a16-68b5-41a8-a3f6-27f314a231da/ffff9a651fe84000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787862606.707127:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1787862606.707438:0:6671:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787862606.707478:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a651fe86000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862606.707692:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2345:x1874709516939520:12345-192.168.202.60@tcp:8:bash.0 Request processed in 715us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862606.707701:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:1.0:1787862606.717733:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862606.717850:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939648 00000100:00100000:0.0:1787862606.717867:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939648 00000100:00080000:3.0:1787862606.717969:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862606.717975:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1787862606.717994:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:0:x1874709516939648:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862606.718014:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862606.718038:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346d3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862606.718110:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862606.718193:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1787862606.718201:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862606.718218:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.718252:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.718305:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919400, rc 0) 00000100:00100000:1.0:1787862606.718652:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:0:x1874709516939648:12345-192.168.202.60@tcp:101:bash.0 Request processed in 664us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862606.718663:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1787862606.722640:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862606.722737:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939776 00000100:00100000:1.0:1787862606.722755:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939776 00000100:00100000:1.0:1787862606.722830:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787862606.722838:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:10276:x1874709516939776:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862606.722863:0:11687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862606.722893:0:11687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346da expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.722946:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.722957:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862606.722962:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862606.722968:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.723013:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.723027:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 8 pid: 6670 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862606.723105:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11687:1874709526416384:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862606.723222:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e21a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862606.734794:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862606.734879:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516939904 00000100:00100000:2.0:1787862606.734889:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516939904 00010000:00010000:2.0:1787862606.734933:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 9 pid: 6670 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862606.734988:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:2.0:1787862606.734999:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516939904:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862606.735015:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862606.735058:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 9 pid: 6670 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.735075:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 9 pid: 6670 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.735120:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862606.735126:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862606.735138:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.735149:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.735190:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862606.735206:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874709526416512:192.168.202.60@tcp:105: 00000100:00100000:2.0:1787862606.735315:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102c5f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787862606.736031:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a05aeac/0x9c5536ccf892ffce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346d3 expref: 9 pid: 6670 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862606.736075:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11687:1874709526416384:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862606.736103:0:11687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.736113:0:11687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f600, rc 0) 00000100:00100000:1.0:1787862606.736151:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:10276:x1874709516939776:12345-192.168.202.60@tcp:101:bash.0 Request processed in 13313us (13522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862606.736158:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1787862606.738386:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862606.738644:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516940160 00000100:00100000:3.0:1787862606.738655:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516940160 00000100:00100000:2.0:1787862606.738808:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874709526416512:192.168.202.60@tcp:105: 00010000:00010000:2.0:1787862606.738836:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862606.738895:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516939904:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 3897us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862606.738905:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:3.0:1787862606.738981:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1787862606.738993:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+12:10276:x1874709516940160:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:3.0:1787862606.739349:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+13:10276:x1874709516940160:12345-192.168.202.60@tcp:35:bash.0 Request processed in 358us (971us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787862606.739369:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:1.0:1787862606.872605:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862606.872757:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516940416 00000100:00100000:2.0:1787862606.872768:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516940416 00000100:00100000:2.0:1787862606.872837:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:2.0:1787862606.872847:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+13:10286:x1874709516940416:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862606.872872:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862606.872892:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346e1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862606.873633:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787862606.873756:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffdc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346e1 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.873772:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:2.0:1787862606.873784:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862606.873790:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf892ffdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346e1 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.873805:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:2.0:1787862606.873927:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+14:10286:x1874709516940416:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1080us (1331us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787862606.873935:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1787862606.886709:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862606.887083:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516940672 00000100:00100000:0.0:1787862606.887095:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516940672 00000100:00100000:0.0:1787862606.887163:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787862606.887173:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+14:10286:x1874709516940672:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862606.888180:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+15:10286:x1874709516940672:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 1003us (1475us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787862606.888191:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787862606.971548:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862606.972503:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516940800 00000100:00100000:1.0:1787862606.972522:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516940800 00000100:00100000:1.0:1787862606.972701:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1787862606.972724:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:10292:x1874709516940800:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862606.972758:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862606.972817:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ffea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346e8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.972922:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.972942:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.972959:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862606.973240:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787862606.973245:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862606.973296:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.973334:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf892ffea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346e8 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.973359:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346e8 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.973496:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862606.973500:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862606.973505:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204fa00, rc 0) 00000100:00100000:1.0:1787862606.973666:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:10292:x1874709516940800:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 944us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862606.973675:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1787862606.979456:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862606.979581:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941056 00000100:00100000:3.0:1787862606.979595:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941056 00000100:00100000:3.0:1787862606.979868:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:3.0:1787862606.979885:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+16:10292:x1874709516941056:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862606.979918:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862606.979947:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf892fff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346ef expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.980138:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf892ffff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.980157:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf892ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.980173:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf892ffff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862606.980188:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787862606.980399:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf892fff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346ef expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.980424:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf892ffff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346ef expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862606.980434:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:3.0:1787862606.980437:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862606.980442:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c800, rc 0) 00000100:00100000:3.0:1787862606.980547:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+18:10292:x1874709516941056:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 665us (1179us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787862606.987570:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862606.988357:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862606.988509:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862606.988592:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941312 00000100:00100000:2.0:1787862606.988607:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941312 00000100:00100000:2.0:1787862606.988696:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:2.0:1787862606.988709:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511600b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+18:10292:x1874709516941312:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862606.988746:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862606.988803:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893000d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346f6 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.988941:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930014 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.988960:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.989013:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862606.989032:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787862606.989505:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893000d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346f6 expref: 21 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.989529:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346f6 expref: 20 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862606.989540:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:2.0:1787862606.989543:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787862606.989548:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc000, rc 0) 00000100:00100000:2.0:1787862606.989637:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511600b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+20:10292:x1874709516941312:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 930us (1126us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787862606.989646:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:1.0:1787862606.994773:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941440 00000100:00100000:1.0:1787862606.994796:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941440 00000100:00100000:1.0:1787862606.994917:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:1.0:1787862606.994930:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:2347:x1874709516941440:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862606.994953:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862606.995004:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf892ffff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346ef expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862606.995033:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:1.0:1787862606.995067:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862606.995165:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:2347:x1874709516941440:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 238us (6810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862606.995174:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:0.0:1787862606.997480:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862606.997926:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941568 00000100:00100000:1.0:1787862606.997940:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941568 00000100:00100000:0.0:1787862606.998156:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862606.998169:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511603840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:2346:x1874709516941568:12345-192.168.202.60@tcp:1:lfs.0 00010000:00010000:0.0:1787862606.998232:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.998259:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.998300:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862606.998306:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862606.998312:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.998360:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862606.998390:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862606.998410:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65116003c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1874709526416640:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862606.998539:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862607.002605:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65116003c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1874709526416640:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862607.002658:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862607.003434:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.010660:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941696 00000100:00100000:1.0:1787862607.010684:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941696 00002000:00100000:1.0:1787862607.010777:0:6675:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a65116003c0 x1874709516941696/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:723/0 lens 504/0 e 0 to 0 dl 1787862618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862607.010793:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65116003c0 with x1874709516941696 ext(0->12) 00010000:00010000:1.0:1787862607.010808:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 8 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.010833:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 8 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862607.010842:0:6675:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a65116003c0 00000100:00100000:1.0:1787862607.010911:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1787862607.010923:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516941696:12345-192.168.202.60@tcp:4:lfs.0 00000001:00100000:2.0:1787862607.052721:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000100:00100000:1.0:1787862607.053085:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.053142:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862607.053208:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941952 00000100:00100000:2.0:1787862607.053221:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941952 00000100:00100000:2.0:1787862607.053778:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 152 00000100:00100000:2.0:1787862607.053793:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516941952:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862607.053950:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:2349:x1874709516941952:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 162us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862607.053959:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 152 00000100:00100000:2.0:1787862607.053991:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516941824 00000100:00100000:2.0:1787862607.053997:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516941824 00000100:00100000:2.0:1787862607.054066:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 296 00000100:00100000:2.0:1787862607.054074:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516941824:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862607.054349:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516941824:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 274us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862607.054358:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 296 00000100:00080000:2.0:1787862607.054391:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787862607.100859:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787862607.101109:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516941696:12345-192.168.202.60@tcp:4:lfs.0 Request processed in 90180us (97671us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787862607.101129:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00002000:00100000:1.0:1787862607.101148:0:6675:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a65116003c0 x1874709516941696/t4294967299(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:723/0 lens 504/448 e 0 to 0 dl 1787862618 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787862607.101159:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65116003c0 with x1874709516941696 ext(0->12) 00010000:00010000:1.0:1787862607.101174:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.101199:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862607.101208:0:6675:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a65116003c0 00000100:00100000:1.0:1787862607.104919:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862607.105036:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516942080 00000100:00100000:3.0:1787862607.105091:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516942080 00010000:00010000:3.0:1787862607.105146:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862607.105203:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:3.0:1787862607.105216:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516942080:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862607.105235:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787862607.105265:0:5801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787862607.105278:0:5801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787862606 00002000:00010000:3.0:1787862607.105281:0:5801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787862606 00002000:00010000:3.0:1787862607.105284:0:5801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787862606 00002000:00010000:3.0:1787862607.105286:0:5801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787862607.105294:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.105314:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.105391:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000871bc90b/0x9c5536ccf892ffd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346da expref: 7 pid: 11687 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.105416:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862607.105421:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862607.105428:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.105439:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.105475:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862607.105547:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516942080:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 333us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862607.105557:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00010000:00010000:1.0:1787862607.105791:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105802:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105834:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105851:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105860:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105869:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862607.105874:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105884:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105899:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.105909:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5479018/0x9c5536ccf8930022 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862607.105984:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511603840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516941568:12345-192.168.202.60@tcp:1:lfs.0 Request processed in 107818us (108519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862607.105994:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787862607.110286:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862607.110617:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516942336 00000100:00100000:3.0:1787862607.110633:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516942336 00000100:00100000:3.0:1787862607.110730:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1787862607.110744:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:10292:x1874709516942336:12345-192.168.202.60@tcp:35:lfs.0 00000004:00010000:3.0:1787862607.110839:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346f6 expref: 19 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862607.111258:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787862607.111347:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787862607.113974:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787862607.114152:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.114178:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 23 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.114189:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.114241:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 23 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.114288:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 23 pid: 7147 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862607.114308:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511601e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874709526416768:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862607.114443:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862607.118236:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862607.118415:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516942464 00000100:00100000:3.0:1787862607.118428:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516942464 00010000:00010000:3.0:1787862607.118502:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 24 pid: 7147 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862607.118554:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:3.0:1787862607.118564:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+24:2348:x1874709516942464:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862607.118584:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862607.118592:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 24 pid: 7147 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.118609:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 24 pid: 7147 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.118638:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:3.0:1787862607.118646:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.118657:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.118665:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.118689:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862607.118758:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+24:2348:x1874709516942464:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 194us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862607.118767:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00010000:00010000:0.0:1787862607.119552:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf892ffb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b346cc expref: 23 pid: 7147 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862607.119578:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511601e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874709526416768:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862607.119610:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.119620:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.119626:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862607.119813:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787862607.120125:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787862607.120317:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511601e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526416896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787862607.121665:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862607.121876:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862607.121939:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526416896 00000100:00100000:0.0:1787862607.121949:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526416896 00000100:00100000:0.0:1787862607.122098:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862607.122110:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874709526416896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862607.122231:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874709526416896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862607.122253:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862607.122501:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511601e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526416896:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1787862607.123825:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787862607.123917:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787862607.124037:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526417024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787862607.124230:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862607.124320:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e21000 going to sleep for 11 seconds 00000100:00100000:0.0:1787862607.124433:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417024 00000100:00100000:0.0:1787862607.124442:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417024 00000100:00100000:0.0:1787862607.124550:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862607.124561:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874709526417024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862607.124916:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1874709526417024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 355us (685us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787862607.124926:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862607.125008:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea83c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526417024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787862607.125138:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787862607.125191:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.125205:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.125215:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.125223:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862607.125229:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.125241:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.125262:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:1.0:1787862607.125266:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787862607.125284:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.125292:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930029 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862607.125509:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787862607.125771:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787862607.125785:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332889741571ns, next at 333889739251ns, rc = 0 00000001:00080000:1.0:1787862607.125792:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787862607.125828:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:1.0:1787862607.125832:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862607.125840:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930014 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346f6 expref: 27 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862607.125965:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+26:10292:x1874709516942336:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 15224us (15705us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787862607.125975:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000020:00080000:1.0:1787862607.125980:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787862607.129613:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862607.129790:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516942592 00000100:00100000:3.0:1787862607.129803:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516942592 00000100:00100000:3.0:1787862607.129911:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1787862607.129944:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+26:10292:x1874709516942592:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862607.129977:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862607.130010:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8930030 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b346fd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.130131:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8930030 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346fd expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.130149:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8930030 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346fd expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862607.130172:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787862607.130175:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862607.130180:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c400, rc 0) 00000100:00100000:3.0:1787862607.130259:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+27:10292:x1874709516942592:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 318us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862607.130275:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:2.0:1787862607.139920:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.140088:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516942848 00000100:00100000:1.0:1787862607.140102:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516942848 00000100:00100000:1.0:1787862607.140183:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862607.140196:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+27:10292:x1874709516942848:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862607.140533:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+28:10292:x1874709516942848:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 338us (626us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787862607.140542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862607.253263:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862607.253752:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516943104 00000100:00100000:0.0:1787862607.253783:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516943104 00000100:00100000:0.0:1787862607.253922:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1787862607.253935:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+28:10302:x1874709516943104:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862607.253984:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862607.254264:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34704 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862607.254545:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787862607.255616:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930037 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34704 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.255661:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:0.0:1787862607.255665:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862607.255679:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34704 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.255708:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00100000:0.0:1787862607.257319:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:10302:x1874709516943104:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 3372us (4075us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787862607.257365:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1787862607.273972:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862607.274150:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516943232 00000100:00100000:2.0:1787862607.274164:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516943232 00000100:00100000:2.0:1787862607.274244:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:2.0:1787862607.274257:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511602d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+29:10302:x1874709516943232:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:2.0:1787862607.274572:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274597:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274617:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274638:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274646:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274676:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274819:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274828:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274836:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862607.274893:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274910:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274918:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274926:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274933:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862607.274938:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274946:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.274960:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862607.276098:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862607.276186:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276198:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276225:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276233:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276239:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276245:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862607.276249:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276256:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276282:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6507fe6600) 00010000:00010000:2.0:1787862607.276286:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862607.276289:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276295:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893004c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276317:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276461:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276467:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276473:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862607.276476:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276482:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276491:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862607.276493:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862607.276497:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.276502:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862607.276710:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511602d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+29:10302:x1874709516943232:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 2449us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862607.276722:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:0.0:1787862607.288897:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.289463:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516943488 00000100:00100000:1.0:1787862607.289480:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516943488 00000100:00100000:1.0:1787862607.289577:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:1.0:1787862607.289594:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+29:10302:x1874709516943488:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862607.293097:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+30:10302:x1874709516943488:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 3454us (4164us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787862607.293248:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:1.0:1787862607.341756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862607.341893:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516943744 00000100:00100000:2.0:1787862607.341909:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516943744 00000100:00100000:2.0:1787862607.342001:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:2.0:1787862607.342013:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+30:10305:x1874709516943744:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862607.342100:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862607.342148:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893005a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3470b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342255:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342285:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342301:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342319:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342467:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342476:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342636:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342646:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342654:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862607.342666:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787862607.342790:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342809:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342817:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342824:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862607.342829:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342839:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342852:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862607.342855:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862607.342860:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342866:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342882:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342888:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342895:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342900:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862607.342906:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342913:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342920:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6507fe6600) 00010000:00010000:2.0:1787862607.342923:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862607.342926:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342931:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8930068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.342979:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893005a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.343002:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.343010:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862607.343012:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862607.343015:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787862607.344451:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+32:10305:x1874709516943744:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 2427us (2699us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787862607.344467:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1787862607.350859:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.351245:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516943872 00000100:00100000:1.0:1787862607.351262:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516943872 00000100:00100000:1.0:1787862607.351365:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:1.0:1787862607.351379:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511540b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+32:10305:x1874709516943872:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:1.0:1787862607.351484:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351505:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351518:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351552:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351559:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351567:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351574:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862607.351579:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351588:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351602:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862607.351605:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862607.351635:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.351643:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893007d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862607.351777:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511540b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+32:10305:x1874709516943872:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 401us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862607.351786:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:3.0:1787862607.355577:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.355744:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516944128 00000100:00100000:1.0:1787862607.355762:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516944128 00000100:00100000:1.0:1787862607.355854:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1787862607.355868:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511543840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+32:10305:x1874709516944128:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862607.356260:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511543840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+33:10305:x1874709516944128:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 393us (697us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787862607.356280:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00010000:00010000:3.0:1787862607.452585:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862607.516728:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862607.516834:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862607.516863:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526417280:0@lo:400:kworker.0 00000100:00100000:0.0:1787862607.516958:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862607.517081:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417280 00000100:00100000:0.0:1787862607.517090:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417280 00000100:00100000:0.0:1787862607.517163:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787862607.517174:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511603c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526417280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862607.517237:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511603c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526417280:12345-0@lo:400:kworker.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862607.517245:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787862607.517311:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526417280:0@lo:400:kworker.0 00000100:00100000:3.0:1787862607.526400:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526417152:0@lo:400:kworker.0 00000100:00100000:3.0:1787862607.526541:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862607.527003:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526417664:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.527070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862607.527103:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862607.527433:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526417792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.527471:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862607.527515:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417792 00000100:00100000:2.0:1787862607.527525:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417792 00000100:00100000:2.0:1787862607.527598:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862607.527611:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526417792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.527678:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526417792:12345-0@lo:400:kworker.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862607.527687:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862607.527827:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526417792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.527883:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417664 00000100:00100000:2.0:1787862607.527887:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417664 00000100:00100000:2.0:1787862607.528035:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787862607.528194:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526417664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.528239:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526417664:12345-0@lo:400:kworker.0 Request processed in 197us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862607.528245:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787862607.528277:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526417408:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.528305:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862607.528573:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417408 00000100:00100000:0.0:1787862607.528579:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417408 00000100:00100000:0.0:1787862607.528621:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787862607.528630:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526417408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862607.528672:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526417408:12345-0@lo:400:kworker.0 Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862607.528679:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1787862607.528699:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862607.528752:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526417664:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.528905:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526417408:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.528919:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862607.529838:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526417536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862607.530635:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862607.531283:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417536 00000100:00100000:0.0:1787862607.531297:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417536 00000100:00100000:0.0:1787862607.531895:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787862607.531909:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526417536:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787862607.532099:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862607.533937:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526417536:12345-0@lo:400:kworker.0 Request processed in 2005us (3281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862607.533957:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787862607.537554:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526417152 00000100:00100000:1.0:1787862607.537590:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526417152 00000100:00100000:1.0:1787862607.537744:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787862607.537761:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526417152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862607.538274:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526417152:12345-0@lo:400:kworker.0 Request processed in 504us (11723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862607.538289:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787862607.541567:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526417152:0@lo:400:kworker.0 00000100:00100000:3.0:1787862607.546275:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526417536:0@lo:400:kworker.0 00000100:00100000:3.0:1787862607.742946:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862607.743274:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516944384 00000100:00100000:2.0:1787862607.743295:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516944384 00000100:00100000:2.0:1787862607.743544:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:2.0:1787862607.743575:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+33:10336:x1874709516944384:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:2.0:1787862607.743610:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862607.743638:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34712 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.743777:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893008b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.743795:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893008b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.743809:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893008b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862607.743823:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787862607.744031:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34712 expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.744135:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893008b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34712 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.744158:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862607.744162:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862607.744167:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:2.0:1787862607.744281:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+35:10336:x1874709516944384:12345-192.168.202.60@tcp:101:cat.0 Request processed in 708us (1352us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787862607.744289:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:3.0:1787862607.756229:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862607.756305:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862607.756517:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516944768 00000100:00100000:2.0:1787862607.756535:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516944768 00000100:00100000:2.0:1787862607.756667:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1787862607.756681:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+35:2346:x1874709516944768:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862607.756707:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862607.756748:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893008b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34712 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.756778:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862607.756785:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862607.756885:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+34:2346:x1874709516944768:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 209us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862607.756894:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:1.0:1787862607.757521:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516944640 00000100:00100000:1.0:1787862607.757533:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516944640 00000100:00100000:1.0:1787862607.757583:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:1.0:1787862607.757591:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511541680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+34:10336:x1874709516944640:12345-192.168.202.60@tcp:35:cat.0 00000100:00100000:1.0:1787862607.758009:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511541680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+35:10336:x1874709516944640:12345-192.168.202.60@tcp:35:cat.0 Request processed in 417us (1790us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787862607.758026:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1787862607.864167:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862607.866433:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516945024 00000100:00100000:0.0:1787862607.866459:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516945024 00000100:00100000:0.0:1787862607.866574:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1787862607.866588:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+35:10342:x1874709516945024:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1787862607.866626:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862607.866630:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787862607.866667:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf892fff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346e8 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.866712:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:0.0:1787862607.866719:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862607.866738:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf8930099 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34719 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.866873:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.866888:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.866899:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.866965:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.866981:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 35 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862607.866997:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65116030c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526417920:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862607.867245:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65011cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862607.872656:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65116030c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526417920:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862607.872704:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862607.873332:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862607.873723:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516945152 00000100:00100000:1.0:1787862607.873732:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516945152 00010000:00010000:1.0:1787862607.873783:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 36 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862607.873834:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:1.0:1787862607.873845:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511542940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+36:2348:x1874709516945152:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862607.873866:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862607.873874:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 36 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.873889:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 36 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.873927:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893006f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3470b expref: 36 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.873947:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862607.873953:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.873970:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.873999:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862607.874086:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862607.874304:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.874314:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862607.874339:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787862607.874452:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511542940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+36:2348:x1874709516945152:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 607us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862607.874462:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00010000:00010000:0.0:1787862607.874571:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf8930099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.874589:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862607.874598:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862607.874601:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862607.874605:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919a00, rc 0) 00000100:00100000:0.0:1787862607.874633:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+35:10342:x1874709516945024:12345-192.168.202.60@tcp:101:dd.0 Request processed in 8048us (10480us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787862607.874639:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1787862607.879634:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862607.879738:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516945408 00000100:00100000:2.0:1787862607.879754:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516945408 00000100:00100000:2.0:1787862607.879827:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:2.0:1787862607.879840:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+35:10342:x1874709516945408:12345-192.168.202.60@tcp:36:dd.0 00010000:00010000:2.0:1787862607.880697:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.880726:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.880741:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862607.880811:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787862607.880844:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097d90597 reply state 000000003aca48c0 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862607.880855:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862607.882657:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+38:10342:x1874709516945408:12345-192.168.202.60@tcp:36:dd.0 Request processed in 2805us (3026us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787862607.882672:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000020:00080000:2.0:1787862607.882682:0:7147:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787862607.885816:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.885839:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.885849:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.885856:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862607.885863:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.885872:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.885895:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862607.885898:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862607.885904:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862607.885925:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862608.031065:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862608.031097:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862608.031198:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862608.031447:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526418048 00000100:00100000:1.0:1787862608.031458:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526418048 00000100:00100000:1.0:1787862608.031531:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787862608.031542:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511601e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874709526418048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862608.031573:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787862608.032847:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511601e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874709526418048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862608.032873:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862608.039662:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862608.194694:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862608.196642:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516945536 00000100:00100000:3.0:1787862608.196666:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516945536 00000100:00080000:0.0:1787862608.196782:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862608.196863:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:3.0:1787862608.196879:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+37:10356:x1874709516945536:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:3.0:1787862608.196918:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862608.196951:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89300b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34720 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197109:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197129:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197143:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197163:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197171:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197178:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.197343:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.199131:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.199154:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.199224:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.199247:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 38 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862608.199277:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511540000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526418176:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862608.201314:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862608.204730:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511540000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526418176:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862608.204776:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862608.204851:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862608.204901:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516945792 00000100:00100000:1.0:1787862608.204910:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516945792 00000100:00100000:1.0:1787862608.204983:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862608.204997:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+39:5589:x1874709516945792:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787862608.205543:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+40:5589:x1874709516945792:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 548us (690us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787862608.205555:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862608.208596:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862608.209322:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516945920 00000100:00100000:2.0:1787862608.209336:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516945920 00010000:00010000:2.0:1787862608.209399:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 40 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862608.209874:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:2.0:1787862608.209887:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+40:2348:x1874709516945920:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862608.209911:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862608.209920:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 40 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.209935:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 40 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.209960:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34719 expref: 40 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.209982:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862608.209990:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.210001:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.210010:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.210200:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862608.210353:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+39:2348:x1874709516945920:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 469us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862608.210363:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00010000:00010000:0.0:1787862608.210442:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210451:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862608.210729:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787862608.210736:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862608.210799:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210817:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210830:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210837:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210844:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210851:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862608.210866:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210876:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210890:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:0.0:1787862608.210893:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862608.210897:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210904:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89300bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210920:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210927:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210934:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210940:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862608.210943:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210948:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210956:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517c53e00) 00010000:00010000:0.0:1787862608.210958:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862608.210968:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.210974:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89300c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.211020:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89300b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34720 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.212356:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34720 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.212375:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862608.212378:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862608.212382:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:0.0:1787862608.212820:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+38:10356:x1874709516945536:12345-192.168.202.60@tcp:101:stat.0 Request processed in 15942us (18138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862608.212832:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:1.0:1787862608.308665:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862608.309628:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516946176 00000100:00100000:2.0:1787862608.309683:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516946176 00000100:00100000:2.0:1787862608.309783:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:2.0:1787862608.309797:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+38:10362:x1874709516946176:12345-192.168.202.60@tcp:36:truncate.0 00010000:00010000:2.0:1787862608.309893:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862608.309936:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89300ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34720 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.309958:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862608.309966:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862608.312138:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.312172:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.312188:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862608.312271:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787862608.312304:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035a786a6 reply state 00000000a37db069 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862608.312313:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862608.314379:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+40:10362:x1874709516946176:12345-192.168.202.60@tcp:36:truncate.0 Request processed in 4560us (5704us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787862608.314400:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000020:00080000:2.0:1787862608.316709:0:5817:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787862608.316823:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.316844:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.316887:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.316895:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862608.316901:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.316910:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.316935:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862608.316939:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862608.316947:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.316956:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89300d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.476335:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862608.524422:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862608.524573:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516946304 00000100:00100000:0.0:1787862608.524588:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516946304 00000100:00100000:0.0:1787862608.524684:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:0.0:1787862608.524756:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+39:10376:x1874709516946304:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:0.0:1787862608.524798:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862608.524832:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89300d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34727 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.524937:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.524985:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.524999:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525018:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525026:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525033:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525274:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525285:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525293:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862608.525338:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787862608.525344:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862608.525367:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525380:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525398:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525404:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525411:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525416:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862608.525420:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525427:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525439:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:0.0:1787862608.525442:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862608.525447:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525452:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89300df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525465:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525470:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525476:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525486:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862608.525489:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525494:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525502:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517dfc800) 00010000:00010000:0.0:1787862608.525504:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862608.525507:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525514:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89300e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525552:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89300d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525566:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.525574:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862608.525576:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862608.525579:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919a00, rc 0) 00000100:00100000:0.0:1787862608.525876:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+40:10376:x1874709516946304:12345-192.168.202.60@tcp:101:stat.0 Request processed in 1181us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862608.525886:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000040:00080000:0.0:1787862608.540905:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787862608.656947:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862608.657245:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516946560 00000100:00100000:0.0:1787862608.657311:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516946560 00000100:00100000:0.0:1787862608.657405:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:0.0:1787862608.657418:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+40:10386:x1874709516946560:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862608.657452:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862608.657483:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89300f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3472e expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862608.657653:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787862608.657828:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89300f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3472e expref: 42 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.657846:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:0.0:1787862608.657850:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862608.657856:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89300f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3472e expref: 42 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.657876:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918000, rc 0) 00000100:00100000:0.0:1787862608.658574:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+41:10386:x1874709516946560:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1153us (1640us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787862608.658584:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:1.0:1787862608.665636:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862608.665798:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516946816 00000100:00100000:2.0:1787862608.665816:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516946816 00000100:00100000:2.0:1787862608.665901:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1787862608.665922:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+41:10386:x1874709516946816:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787862608.666385:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+42:10386:x1874709516946816:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 464us (766us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787862608.666396:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:1.0:1787862608.749753:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862608.750108:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516947072 00000100:00100000:3.0:1787862608.750123:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516947072 00000100:00100000:3.0:1787862608.750201:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:3.0:1787862608.750225:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+42:10391:x1874709516947072:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862608.750268:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862608.750298:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930102 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34735 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.750456:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.750486:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.750497:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.750538:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.750555:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 43 pid: 5816 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862608.750573:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526418304:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862608.750712:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862608.756860:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862608.757022:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516947200 00000100:00100000:1.0:1787862608.757037:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516947200 00010000:00010000:1.0:1787862608.757132:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 44 pid: 5816 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862608.757276:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:1.0:1787862608.757289:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+44:2349:x1874709516947200:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862608.757310:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862608.757318:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 44 pid: 5816 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.757335:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 44 pid: 5816 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.757368:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862608.757375:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.757389:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.757399:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.757438:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862608.757535:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+44:2349:x1874709516947200:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 248us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862608.757544:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 40 00010000:00010000:0.0:1787862608.762306:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89300ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34727 expref: 43 pid: 5816 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862608.762343:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526418304:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862608.762378:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.762434:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.762441:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862608.762471:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787862608.762861:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.762884:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.762894:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862608.762897:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862608.762902:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d600, rc 0) 00000100:00100000:0.0:1787862608.763014:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+43:10391:x1874709516947072:12345-192.168.202.60@tcp:101:bash.0 Request processed in 12791us (13277us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787862608.763024:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:3.0:1787862608.765331:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862608.765439:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516947456 00000100:00100000:0.0:1787862608.765454:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516947456 00000100:00100000:0.0:1787862608.765537:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1787862608.765550:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+43:10391:x1874709516947456:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:0.0:1787862608.765959:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.765982:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.766018:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862608.766112:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787862608.766140:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051da6213 reply state 00000000961a4748 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862608.766151:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862608.766281:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+46:10391:x1874709516947456:12345-192.168.202.60@tcp:36:bash.0 Request processed in 732us (967us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787862608.766290:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000020:00080000:0.0:1787862608.766296:0:7147:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787862608.768642:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.768664:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.768701:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.768709:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862608.768715:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.768723:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.768743:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862608.768747:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862608.768754:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862608.768760:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862608.784160:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862608.784450:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516947584 00000100:00100000:0.0:1787862608.784464:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516947584 00000100:00100000:0.0:1787862608.784533:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:0.0:1787862608.784544:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511542580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+45:10391:x1874709516947584:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862608.784578:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862608.784606:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893011e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3473c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.784732:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.784750:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.784762:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.784827:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.784841:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 46 pid: 5815 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862608.784854:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526418432:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862608.784966:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862608.788319:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526418432:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862608.788366:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862608.789657:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862608.789859:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516947712 00000100:00100000:1.0:1787862608.789871:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516947712 00010000:00010000:1.0:1787862608.789924:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 47 pid: 5815 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862608.790030:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1787862608.790090:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511543c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+47:2349:x1874709516947712:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862608.790111:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862608.790119:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 47 pid: 5815 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.790134:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 47 pid: 5815 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.790162:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf8930109 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34735 expref: 47 pid: 5815 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.790183:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862608.790190:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.790201:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.790613:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862608.790644:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862608.790831:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.790842:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862608.790908:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787862608.790913:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862608.790940:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862608.791201:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511543c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+46:2349:x1874709516947712:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 1155us (1547us total) trans 0 rc 0/0 00010000:00010000:0.0:1787862608.791344:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893011e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3473c expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.791368:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3473c expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.791404:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862608.791407:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1787862608.792321:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00010000:00010000:0.0:1787862608.792451:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919600, rc 0) 00000100:00100000:0.0:1787862608.792529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511542580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+45:10391:x1874709516947584:12345-192.168.202.60@tcp:101:bash.0 Request processed in 7985us (8384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862608.792537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1787862608.799912:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862608.800086:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516947968 00000100:00100000:2.0:1787862608.800101:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516947968 00000100:00100000:2.0:1787862608.800176:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862608.800189:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+45:10391:x1874709516947968:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:2.0:1787862608.800541:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+46:10391:x1874709516947968:12345-192.168.202.60@tcp:35:bash.0 Request processed in 353us (645us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787862608.800550:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862608.914497:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862608.917983:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516948224 00000100:00100000:0.0:1787862608.918004:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516948224 00000100:00100000:0.0:1787862608.918362:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:0.0:1787862608.918378:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+46:10402:x1874709516948224:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862608.918418:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862608.918447:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893012c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34743 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862608.918611:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787862608.918812:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893012c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34743 expref: 48 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.918830:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:0.0:1787862608.918834:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862608.918840:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893012c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34743 expref: 48 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862608.918858:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919a00, rc 0) 00000100:00100000:0.0:1787862608.918955:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+47:10402:x1874709516948224:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 581us (4473us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787862608.918986:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:1.0:1787862608.931915:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862608.932264:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516948352 00000100:00100000:3.0:1787862608.932278:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516948352 00000100:00100000:3.0:1787862608.932357:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:3.0:1787862608.932368:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+47:10402:x1874709516948352:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:3.0:1787862608.932483:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932531:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932547:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932569:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932577:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932585:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932716:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932726:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932733:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862608.932787:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932803:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932810:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932828:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932834:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862608.932839:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932848:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932862:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:3.0:1787862608.932865:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862608.932872:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932879:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893013a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932895:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932901:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932907:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932912:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862608.932916:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932931:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.932940:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517c53f00) 00010000:00010000:3.0:1787862608.932942:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862608.932945:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933316:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933334:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933341:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933347:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933352:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862608.933355:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933362:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933370:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787862608.933373:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862608.933376:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862608.933392:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862608.933497:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+47:10402:x1874709516948352:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 1128us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862608.933506:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:3.0:1787862608.937379:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862608.937491:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516948608 00000100:00100000:2.0:1787862608.937505:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516948608 00000100:00100000:2.0:1787862608.937590:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:2.0:1787862608.937621:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511543840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+47:10402:x1874709516948608:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862608.947482:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511543840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+48:10402:x1874709516948608:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 9841us (10093us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787862608.947504:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:2.0:1787862609.012375:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.012524:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516948864 00000100:00100000:1.0:1787862609.012538:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516948864 00000100:00100000:1.0:1787862609.012628:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:1.0:1787862609.012642:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+48:10405:x1874709516948864:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862609.012689:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862609.012718:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893014f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3474a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.012816:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.012834:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.012848:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.012868:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.012875:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.012882:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013111:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013122:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013129:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862609.013142:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787862609.013282:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013291:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013298:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013305:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862609.013311:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013319:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013333:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862609.013336:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862609.013342:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013360:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf8930156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013379:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013386:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013393:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013398:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862609.013401:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.013407:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.014339:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880200) 00010000:00010000:1.0:1787862609.014343:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862609.014349:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.014358:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf893015d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.014431:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf893014f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3474a expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.014448:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3474a expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.014469:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862609.014471:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862609.014475:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f600, rc 0) 00000100:00100000:1.0:1787862609.014572:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+50:10405:x1874709516948864:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1932us (2215us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787862609.014582:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:3.0:1787862609.020512:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.020637:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862609.020790:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516949120 00000100:00100000:2.0:1787862609.020804:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516949120 00000100:00100000:2.0:1787862609.020892:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:2.0:1787862609.020904:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511542d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+50:2349:x1874709516949120:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862609.020928:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862609.020962:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3474a expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.020987:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862609.020994:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862609.021114:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511542d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+49:2349:x1874709516949120:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 211us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862609.021123:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:0.0:1787862609.022529:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516948992 00000100:00100000:0.0:1787862609.022546:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516948992 00000100:00100000:0.0:1787862609.022656:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:0.0:1787862609.022666:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511541680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+49:10405:x1874709516948992:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:0.0:1787862609.022776:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022797:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022811:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022846:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022853:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022860:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022867:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862609.022871:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022880:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022893:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862609.022913:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862609.022919:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.022926:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862609.023030:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511541680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+49:10405:x1874709516948992:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 364us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.023038:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:3.0:1787862609.026394:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.026490:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516949376 00000100:00100000:1.0:1787862609.026503:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516949376 00000100:00100000:1.0:1787862609.026582:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862609.026594:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+49:10405:x1874709516949376:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862609.026920:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+50:10405:x1874709516949376:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 327us (540us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787862609.026929:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862609.160976:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.161166:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516949632 00000100:00100000:0.0:1787862609.161182:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516949632 00000100:00100000:0.0:1787862609.161273:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:0.0:1787862609.161287:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+50:10423:x1874709516949632:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:0.0:1787862609.161327:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862609.161361:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34751 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.161538:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.161562:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.161580:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862609.161598:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787862609.161839:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34751 expref: 53 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.161894:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34751 expref: 52 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.161905:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862609.161909:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787862609.161916:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919400, rc 0) 00000100:00100000:0.0:1787862609.162126:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+52:10423:x1874709516949632:12345-192.168.202.60@tcp:101:cat.0 Request processed in 755us (1092us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787862609.162139:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:3.0:1787862609.198557:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.198711:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516949760 00000100:00100000:0.0:1787862609.198725:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516949760 00000100:00100000:0.0:1787862609.198867:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:0.0:1787862609.198880:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+52:10424:x1874709516949760:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862609.198916:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862609.198944:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893018e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34758 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.199087:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.199106:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.199120:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862609.206014:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787862609.206073:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862609.206142:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.206206:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893018e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34758 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.206239:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34758 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.206259:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:0.0:1787862609.206263:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862609.206268:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918600, rc 0) 00000100:00100000:0.0:1787862609.206397:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:10424:x1874709516949760:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 7518us (7857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.206410:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1787862609.222642:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.222792:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950144 00000100:00100000:1.0:1787862609.222807:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950144 00000100:00100000:1.0:1787862609.222886:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:1.0:1787862609.222898:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:10424:x1874709516950144:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862609.223459:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+54:10424:x1874709516950144:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 561us (835us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787862609.223470:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862609.226429:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862609.226566:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950272 00000100:00100000:2.0:1787862609.226579:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950272 00000100:00100000:2.0:1787862609.226669:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1787862609.226683:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+54:10424:x1874709516950272:12345-192.168.202.60@tcp:103:lfs.0 00010000:00010000:2.0:1787862609.226712:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787862609.226748:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3473c expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.226777:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34751 expref: 53 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.226832:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8930030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346fd expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.226845:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862609.226859:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862609.226935:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+51:10424:x1874709516950272:12345-192.168.202.60@tcp:103:lfs.0 Request processed in 255us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862609.226944:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:3.0:1787862609.230592:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.233657:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950400 00000100:00100000:0.0:1787862609.233692:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950400 00000100:00100000:0.0:1787862609.233793:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:0.0:1787862609.233809:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+51:10424:x1874709516950400:12345-192.168.202.60@tcp:58:lfs.0 00010000:00010000:0.0:1787862609.234017:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.234058:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.234075:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862609.234519:0:7147:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787862609.234773:0:7147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787862609.234859:0:7147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787862609.235163:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+51:10424:x1874709516950400:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 1354us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.235176:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:3.0:1787862609.268201:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.268352:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950528 00000100:00100000:1.0:1787862609.268367:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950528 00000100:00100000:1.0:1787862609.268441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:1.0:1787862609.268454:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+51:10426:x1874709516950528:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862609.268500:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862609.268530:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89301a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3475f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268615:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268635:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268652:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268669:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268677:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268684:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268821:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268829:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268836:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862609.268885:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787862609.268897:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862609.268922:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268936:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268944:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268951:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268965:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268971:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862609.268977:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.268986:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269000:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862609.269003:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862609.269009:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269016:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89301aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269033:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269115:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269121:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269126:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862609.269129:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269136:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269144:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880200) 00010000:00010000:1.0:1787862609.269147:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862609.269149:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269155:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89301b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269195:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89301a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269211:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.269218:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:1.0:1787862609.269220:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862609.269621:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45800, rc 0) 00000100:00100000:1.0:1787862609.269722:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+52:10426:x1874709516950528:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1269us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862609.269732:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00010000:00010000:1.0:1787862609.501683:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862609.564921:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862609.564965:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526418560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862609.565121:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862609.565283:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526418560 00000100:00100000:2.0:1787862609.565294:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526418560 00000100:00100000:2.0:1787862609.565384:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862609.565399:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526418560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862609.565456:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862609.565519:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526418560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862609.565527:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862609.565611:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526418560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787862609.565824:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787862609.569478:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862609.569489:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862609.569549:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787862609.569558:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862609.569749:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f894780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526418688:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787862609.569900:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862609.584968:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f894780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526418688:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862609.593087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862609.593818:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950656 00000100:00100000:2.0:1787862609.593835:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950656 00000100:00100000:2.0:1787862609.593922:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1787862609.593934:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516950656:12345-192.168.202.60@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787862609.594075:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516950656:12345-192.168.202.60@tcp:900:lhsmtool_posix.0 Request processed in 110us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862609.594085:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787862609.598761:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.599078:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950784 00000100:00100000:0.0:1787862609.599099:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950784 00000100:00100000:0.0:1787862609.599199:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:0.0:1787862609.599212:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516950784:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787862609.599275:0:7147:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787862609.599435:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516950784:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 225us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.599444:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:3.0:1787862609.607914:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.608059:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516950912 00000100:00100000:0.0:1787862609.608074:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516950912 00000100:00100000:0.0:1787862609.608139:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:0.0:1787862609.608148:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516950912:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787862609.608218:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608234:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608243:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608275:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608298:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608305:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608341:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608351:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608358:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862609.608683:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787862609.608688:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862609.608707:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608721:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608733:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608741:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608748:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862609.608756:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608772:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608787:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:0.0:1787862609.608792:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862609.608797:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608804:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89301bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608819:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608826:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608832:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608837:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862609.608840:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608848:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608855:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a6517dfc100) 00010000:00010000:0.0:1787862609.608858:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862609.608862:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.608988:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf89301c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609004:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609010:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609016:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609194:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862609.609200:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609207:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609216:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:0.0:1787862609.609218:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862609.609221:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.609227:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89301cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862609.609517:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516950912:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 1366us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862609.609531:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:0.0:1787862609.616373:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862609.616449:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516951168 00000100:00100000:2.0:1787862609.616466:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516951168 00000100:00100000:2.0:1787862609.616553:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:2.0:1787862609.616566:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+52:10437:x1874709516951168:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862609.616595:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862609.616624:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89301d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34766 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.616769:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.616789:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.616821:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862609.616835:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787862609.616983:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.616992:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.616999:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617006:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862609.617011:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617020:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617087:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:2.0:1787862609.617091:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862609.617098:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617106:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89301db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617166:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89301d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34766 expref: 54 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617178:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:2.0:1787862609.617181:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862609.617185:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89301d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34766 expref: 54 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.617195:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:2.0:1787862609.618820:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+53:10437:x1874709516951168:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1378us (1582us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787862609.618837:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:1.0:1787862609.628975:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.632347:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516951296 00000100:00100000:3.0:1787862609.632370:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516951296 00000100:00100000:3.0:1787862609.632493:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:3.0:1787862609.632507:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:10437:x1874709516951296:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787862609.632562:0:5815:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787862609.632719:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:10437:x1874709516951296:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 215us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862609.632729:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:0.0:1787862609.648668:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.650500:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516951552 00000100:00100000:3.0:1787862609.650521:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516951552 00000100:00100000:3.0:1787862609.650599:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:3.0:1787862609.650612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+53:10437:x1874709516951552:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862609.650641:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862609.650645:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787862609.650680:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34758 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.650703:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:3.0:1787862609.650709:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862609.650726:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89301e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3476d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862609.651413:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787862609.651676:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89301f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.651703:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89301f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.651716:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89301f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.651791:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89301e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3476d expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.651825:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89301f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3476d expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.651833:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517c53f00) 00010000:00010000:3.0:1787862609.651836:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862609.651838:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422da00, rc 0) 00000100:00100000:3.0:1787862609.651922:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+54:10437:x1874709516951552:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1312us (3271us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787862609.651932:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:3.0:1787862609.675174:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.685324:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516951808 00000100:00100000:1.0:1787862609.685350:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516951808 00000100:00100000:2.0:1787862609.688749:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:2.0:1787862609.688769:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+54:10437:x1874709516951808:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862609.688871:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862609.688909:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89301f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3476d expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.688934:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517c53f00) 00010000:00010000:2.0:1787862609.688966:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862609.688999:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689015:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689028:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689087:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689096:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689103:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689210:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689219:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689227:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689235:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862609.689240:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689257:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689276:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862609.689279:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862609.689284:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689292:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89301fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689312:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689319:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689325:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689331:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862609.689334:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689340:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689347:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xec682a4c (ffff9a6507fe6600) 00010000:00010000:2.0:1787862609.689350:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862609.689353:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.689359:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec682a4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862609.689508:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:10437:x1874709516951808:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 743us (14348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862609.689517:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:3.0:1787862609.695179:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.695263:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516951936 00000100:00100000:0.0:1787862609.695282:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516951936 00000100:00100000:0.0:1787862609.695383:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:0.0:1787862609.695397:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+53:10437:x1874709516951936:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862609.695427:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862609.695456:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893020c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34774 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.695506:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.695525:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.695540:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.695673:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893020c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.695693:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.695704:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:0.0:1787862609.695707:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787862609.695713:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00100000:0.0:1787862609.695815:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+54:10437:x1874709516951936:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 421us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.695823:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:0.0:1787862609.718501:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862609.718992:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516952192 00000100:00100000:2.0:1787862609.719008:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516952192 00000100:00100000:2.0:1787862609.719156:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 75 00000100:00100000:2.0:1787862609.719169:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+54:10437:x1874709516952192:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862609.719307:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.719332:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862609.719349:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862609.719785:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787862609.719798:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335483754582ns, next at 336483750994ns, rc = 0 00000004:00010000:2.0:1787862609.719928:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052265fc0 reply state 000000005101d655 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862609.719940:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862609.720148:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:10437:x1874709516952192:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 978us (1657us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787862609.720159:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 75 00010000:00010000:0.0:1787862609.726007:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.726101:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.726109:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.726115:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862609.726121:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.726130:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.726152:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:0.0:1787862609.726155:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787862609.726161:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.726167:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893021a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862609.730307:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.730681:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516952320 00000100:00100000:3.0:1787862609.730695:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516952320 00000100:00100000:3.0:1787862609.730773:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:3.0:1787862609.730785:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+55:10437:x1874709516952320:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862609.730812:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862609.730834:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3477b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.730955:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.730971:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862609.731002:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:3.0:1787862609.731005:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862609.731010:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d000, rc 0) 00000100:00100000:3.0:1787862609.731285:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+56:10437:x1874709516952320:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 501us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862609.731297:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:2.0:1787862609.740881:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.740974:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516952448 00000100:00100000:3.0:1787862609.740984:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516952448 00000100:00100000:3.0:1787862609.741038:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:3.0:1787862609.741073:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874709516952448:12345-192.168.202.60@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787862609.741108:0:6671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:3.0:1787862609.741137:0:6671:0:(genops.c:1385:class_connect()) connect: client 21567a16-68b5-41a8-a3f6-27f314a231da, cookie 0x9c5536ccf8930228 00002000:00100000:3.0:1787862609.741150:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 21567a16-68b5-41a8-a3f6-27f314a231da/ffff9a6526cc8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862609.741162:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1787862609.741671:0:6671:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787862609.741710:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a6526cca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862609.741830:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2345:x1874709516952448:12345-192.168.202.60@tcp:8:lhsmtool_posix.0 Request processed in 756us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862609.741855:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1787862609.746668:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.746783:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516952576 00000100:00100000:1.0:1787862609.746810:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516952576 00000100:00100000:1.0:1787862609.746919:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:1.0:1787862609.746933:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:0:x1874709516952576:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787862609.747912:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862609.832700:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:0:x1874709516952576:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 85748us (86028us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787862609.832723:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000001:00080000:0.0:1787862609.833426:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787862609.833448:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000100:00100000:0.0:1787862609.850301:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.853393:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516952832 00000100:00100000:1.0:1787862609.853417:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516952832 00000100:00100000:1.0:1787862609.853564:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787862609.853578:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:10437:x1874709516952832:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787862609.854025:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+57:10437:x1874709516952832:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 368us (3665us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787862609.854035:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:2.0:1787862609.858871:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.859111:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953088 00000100:00100000:3.0:1787862609.859128:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953088 00000100:00100000:3.0:1787862609.859213:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:3.0:1787862609.859225:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+57:10437:x1874709516953088:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862609.859382:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+57:10437:x1874709516953088:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 158us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862609.859390:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:1.0:1787862609.869833:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862609.869896:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953216 00000100:00100000:1.0:1787862609.869909:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953216 00000100:00100000:1.0:1787862609.869985:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:1.0:1787862609.870007:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+57:10437:x1874709516953216:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862609.870038:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862609.870085:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893022f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34782 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.870197:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.870216:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.870230:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862609.870292:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862609.870316:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.870348:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893022f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34782 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.870369:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34782 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862609.870379:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:1.0:1787862609.870383:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787862609.870388:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45200, rc 0) 00000100:00100000:1.0:1787862609.870468:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+58:10437:x1874709516953216:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 465us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862609.870485:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:1.0:1787862609.877237:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.877320:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953344 00000100:00100000:0.0:1787862609.877337:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953344 00000100:00100000:0.0:1787862609.877422:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:0.0:1787862609.877436:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516953344:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862609.877480:0:11687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862609.877511:0:11687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34789 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862609.877552:0:11687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909e51, blocks: 0x1 00010000:00010000:0.0:1787862609.877585:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1787862609.877591:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862609.877618:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 6 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.877645:0:11687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 6 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.877662:0:11687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918e00, rc 0) 00000100:00100000:0.0:1787862609.877764:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516953344:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 331us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.877773:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1787862609.888596:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862609.888757:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953600 00000100:00100000:3.0:1787862609.888773:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953600 00000100:00100000:3.0:1787862609.888871:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:3.0:1787862609.888885:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+58:10437:x1874709516953600:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862609.889072:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+58:10437:x1874709516953600:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 189us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862609.889081:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:1.0:1787862609.898207:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.898488:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953728 00000100:00100000:0.0:1787862609.898502:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953728 00000100:00100000:0.0:1787862609.898576:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:0.0:1787862609.898587:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:10437:x1874709516953728:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862609.898613:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862609.898635:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34790 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.898676:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.898699:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862609.898704:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862609.898710:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.898764:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.898780:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862609.898797:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511545e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1874709526418816:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862609.898921:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102ef780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862609.903159:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511545e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6672:1874709526418816:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862609.903211:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.903250:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919400, rc 0) 00000100:00100000:0.0:1787862609.903334:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:10437:x1874709516953728:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 4747us (5140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862609.903343:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:3.0:1787862609.903997:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.904170:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953856 00000100:00100000:0.0:1787862609.904180:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953856 00010000:00010000:0.0:1787862609.904228:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862609.904304:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:0.0:1787862609.904315:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516953856:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862609.904333:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862609.904364:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.904381:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.904414:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf893023d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34789 expref: 7 pid: 11687 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.904433:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862609.904438:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862609.904447:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.904458:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862609.904502:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862609.904519:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511545e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5802:1874709526418944:192.168.202.60@tcp:105: 00000100:00100000:0.0:1787862609.904622:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102ef780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862609.908482:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511545e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5802:1874709526418944:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787862609.908517:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862609.908589:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516953856:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 4274us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862609.908602:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:3.0:1787862609.913903:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862609.917146:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516953984 00000100:00100000:0.0:1787862609.917171:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516953984 00002000:00100000:0.0:1787862609.917260:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a651f897840 x1874709516953984/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:725/0 lens 504/0 e 0 to 0 dl 1787862620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862609.917274:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a651f897840 with x1874709516953984 ext(0->8) 00002000:00010000:0.0:1787862609.917282:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a651f897840 00000100:00100000:0.0:1787862609.917327:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787862609.917338:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516953984:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787862609.918414:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516953984:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 Request processed in 1069us (4517us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787862609.918431:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00002000:00100000:0.0:1787862609.918447:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a651f897840 x1874709516953984/t4294967302(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:725/0 lens 504/448 e 0 to 0 dl 1787862620 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862609.918458:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a651f897840 with x1874709516953984 ext(0->8) 00002000:00010000:0.0:1787862609.918464:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a651f897840 00000100:00100000:3.0:1787862609.922170:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862609.922354:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516954112 00000100:00100000:2.0:1787862609.922367:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516954112 00000100:00100000:2.0:1787862609.922452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:2.0:1787862609.922466:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+58:10437:x1874709516954112:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787862610.010595:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+58:10437:x1874709516954112:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 88113us (88423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862610.010836:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 80 00000001:00080000:1.0:1787862610.010901:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1787862610.010939:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787862610.010974:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787862610.011002:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6537e21e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787862610.011007:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6534121500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6537e21240 00000020:00080000:1.0:1787862610.011011:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6534121b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a653d9e2c00 00000004:00080000:1.0:1787862610.011032:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1787862610.011261:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526419072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787862610.011334:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862610.011400:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862610.011406:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526419200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787862610.011437:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787862610.011466:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1787862610.011487:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526419072 00000100:00100000:0.0:1787862610.011495:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526419072 00000100:00100000:0.0:1787862610.011551:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526419200 00000100:00100000:0.0:1787862610.011554:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526419200 00000100:00100000:0.0:1787862610.011595:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862610.011604:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526419072:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787862610.011633:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00002000:00080000:0.0:1787862610.011639:0:11687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787862610.011682:0:11687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a909e4e, atime: 0x6a909e4e, ctime: 0x6a909e4e, blocks: 0xb 00010000:00010000:0.0:1787862610.011693:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.011715:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1787862610.011721:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862610.011730:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.011754:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.011766:0:11687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.011775:0:11687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.011805:0:11687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862610.011866:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862610.011875:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.011884:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918e00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862610.011896:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.011907:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.011945:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.011969:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060d5579e/0x9c5536ccf893024b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.011989:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862610.011991:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862610.011993:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862610.012018:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787862610.012031:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a654039a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526419200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787862610.012203:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787862610.012206:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787862609 00002000:00010000:1.0:1787862610.012208:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862610.012211:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787862609 -> 1787862609 00002000:00010000:1.0:1787862610.012219:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787862610.012281:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a654039a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526419200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (843us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787862610.012288:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787862610.012397:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6401b3f480/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787862610.012404:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1874709526419072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 801us (1070us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787862610.012405:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526419200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787862610.012412:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1787862610.012417:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6511544780/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787862610.012421:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526419072:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1787862610.012617:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862610.015829:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.016940:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516954240 00000100:00100000:1.0:1787862610.016958:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516954240 00000100:00100000:1.0:1787862610.017060:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:1.0:1787862610.017075:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516954240:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787862610.061839:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516954240:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 44749us (46009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862610.061859:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000001:00080000:0.0:1787862610.062011:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787862610.062038:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787862610.066026:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.070506:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516954496 00000100:00100000:3.0:1787862610.070533:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516954496 00000100:00080000:2.0:1787862610.070620:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862610.070664:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:3.0:1787862610.070678:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+13:10437:x1874709516954496:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862610.070766:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862610.070805:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930236 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34782 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.070857:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:3.0:1787862610.070865:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862610.070924:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.070938:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.070950:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862610.071486:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa73fdcc reply state 0000000076feb407 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.071499:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862610.071634:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+14:10437:x1874709516954496:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 958us (5623us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787862610.071644:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:1.0:1787862610.077363:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862610.077466:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516954624 00000100:00100000:0.0:1787862610.077481:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516954624 00000100:00100000:0.0:1787862610.077565:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:0.0:1787862610.077577:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516954624:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787862610.077971:0:11687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787862610.077976:0:11687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787862609 -> 1787862608 00002000:00010000:0.0:1787862610.077978:0:11687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787862606 00002000:00010000:0.0:1787862610.077981:0:11687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787862609 -> 1787862608 00002000:00010000:0.0:1787862610.077983:0:11687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787862610.078090:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516954624:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 513us (741us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787862610.078100:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00010000:00010000:2.0:1787862610.079075:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.079093:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.079102:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.079109:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862610.079115:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.079125:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.079149:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:2.0:1787862610.079153:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862610.079184:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.079192:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8930252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862610.081271:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.081367:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516954880 00000100:00100000:1.0:1787862610.081381:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516954880 00000100:00100000:1.0:1787862610.081458:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:1.0:1787862610.081470:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+13:10437:x1874709516954880:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787862610.081575:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.081596:0:7147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.081768:0:7147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.081814:0:7147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.081830:0:7147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 13 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.081871:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526419328:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862610.082102:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862610.085372:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.085565:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526419328:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862610.085606:0:7147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.085687:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516955008 00000100:00100000:2.0:1787862610.085695:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516955008 00010000:00010000:2.0:1787862610.085747:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.085797:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:2.0:1787862610.085809:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+14:2348:x1874709516955008:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862610.085828:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862610.085835:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.085850:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.085876:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34774 expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.085893:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:2.0:1787862610.085899:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.085911:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.085941:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.085982:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862610.086225:0:7147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086234:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086284:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086292:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086299:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086317:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862610.086322:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086331:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086341:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:0.0:1787862610.086344:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787862610.086348:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.086355:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930259 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.086499:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+13:2348:x1874709516955008:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 691us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862610.086507:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862610.086887:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+12:10437:x1874709516954880:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 Request processed in 5419us (5633us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787862610.086949:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787862610.089814:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862610.089926:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516955136 00000100:00100000:0.0:1787862610.090219:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516955136 00000100:00100000:0.0:1787862610.090311:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:0.0:1787862610.090324:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516955136:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787862610.090392:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.090419:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.090453:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862610.090458:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862610.090463:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.090509:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.090525:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 7 pid: 6672 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862610.090545:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526419456:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862610.091327:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862610.093724:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.093844:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526419456:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862610.093882:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.094289:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516955264 00000100:00100000:3.0:1787862610.094299:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516955264 00010000:00010000:2.0:1787862610.094416:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 8 pid: 6672 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.094455:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:2.0:1787862610.094467:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516955264:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862610.094485:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862610.094512:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 8 pid: 6672 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.094527:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 8 pid: 6672 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.094553:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a05aeac/0x9c5536ccf8930244 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34790 expref: 8 pid: 6672 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.094569:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862610.094573:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862610.094578:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.094605:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.094631:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862610.094657:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.094665:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.094700:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516955264:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 234us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862610.094709:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00010000:00010000:1.0:1787862610.096074:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.096090:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.096100:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.096131:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918e00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862610.096136:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.096146:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.096169:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.096178:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d5579e/0x9c5536ccf8930260 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.096353:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516955136:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 6027us (6549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862610.096363:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:3.0:1787862610.102550:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.102838:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516955520 00000100:00100000:1.0:1787862610.102852:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516955520 00000100:00100000:1.0:1787862610.102932:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:1.0:1787862610.102952:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+12:10437:x1874709516955520:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862610.103088:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103112:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103148:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103465:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103478:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103489:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103534:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.103550:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 13 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.103567:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526419584:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862610.105825:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862610.112122:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526419584:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862610.112169:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.118263:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.119402:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516955648 00000100:00100000:3.0:1787862610.119417:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516955648 00010000:00010000:3.0:1787862610.119477:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.119539:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1787862610.119564:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+14:2349:x1874709516955648:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862610.119585:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862610.119594:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.119612:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.119642:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3477b expref: 14 pid: 5817 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.119660:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:3.0:1787862610.119666:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.119700:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.119710:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.119903:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862610.120651:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+13:2349:x1874709516955648:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 1083us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862610.120664:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00010000:00010000:1.0:1787862610.123285:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.123335:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862610.123631:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787862610.126346:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787862610.126426:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787862610.126541:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874709526419712:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787862610.126631:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862610.127331:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517ef10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862610.136221:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526419712 00000100:00100000:2.0:1787862610.136254:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526419712 00000100:00100000:2.0:1787862610.136406:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862610.136419:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1874709526419712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787862610.136603:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1874709526419712:12345-0@lo:1000:mdt00_001.0 Request processed in 187us (9971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862610.136612:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862610.138765:0:5816:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787862610.138781:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6401b3f480, transno 4294967303 00000100:00100000:1.0:1787862610.138804:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874709526419712:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787862610.139489:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787862610.139605:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874709526419840:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787862610.139712:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862610.148317:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862610.151748:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526419840 00000100:00100000:3.0:1787862610.151769:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526419840 00000100:00100000:3.0:1787862610.151896:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862610.151908:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1874709526419840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787862610.156445:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1874709526419840:12345-0@lo:1000:mdt00_001.0 Request processed in 4523us (16717us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787862610.156468:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862610.156569:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874709526419840:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787862610.156631:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156644:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156653:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156660:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.156665:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156673:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156694:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6517dfc100) 00010000:00010000:3.0:1787862610.156698:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862610.156705:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156712:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf893026e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156763:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156785:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156791:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156797:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.156800:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156807:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156816:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:3.0:1787862610.156819:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862610.156822:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156828:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893019c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156858:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156875:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156885:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.156932:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.157172:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 16 pid: 5816 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.157191:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f894000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526419968:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862610.157318:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65420d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862610.161734:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.161835:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f894000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526419968:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862610.161874:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.161914:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516955776 00000100:00100000:3.0:1787862610.161924:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516955776 00010000:00010000:3.0:1787862610.164204:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 17 pid: 5816 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.164288:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:3.0:1787862610.164303:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+17:2349:x1874709516955776:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862610.164321:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862610.164333:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 17 pid: 5816 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164349:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 17 pid: 5816 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164376:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89301b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3475f expref: 17 pid: 5816 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164399:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:3.0:1787862610.164405:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164416:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164425:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164456:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862610.164535:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:2349:x1874709516955776:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 237us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862610.164543:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00010000:00010000:3.0:1787862610.164588:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164597:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164611:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164617:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164624:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164631:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.164643:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164652:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164661:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:3.0:1787862610.164664:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862610.164668:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.164930:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930275 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165020:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165027:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165034:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165574:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.165582:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165592:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165605:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517dfc800) 00010000:00010000:3.0:1787862610.165608:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862610.165623:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.165631:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930267 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.168345:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+15:10437:x1874709516955520:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 65379us (65794us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787862610.168365:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00000020:00080000:3.0:1787862610.168376:0:5816:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787862610.169285:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862610.169294:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862610.169331:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787862610.169338:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862610.187643:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.187742:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516956032 00000100:00100000:2.0:1787862610.187757:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516956032 00000100:00100000:2.0:1787862610.187828:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787862610.187840:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+15:10437:x1874709516956032:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787862610.189458:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787862610.189606:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787862610.189674:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.189702:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.189718:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.189729:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.189736:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.189743:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.189774:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787862610.189958:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+17:10437:x1874709516956032:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 2115us (2325us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787862610.189969:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000020:00080000:2.0:1787862610.189976:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862610.192254:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862610.192273:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.192288:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862610.192293:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.192304:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.192326:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6507fe6c00) 00010000:00010000:3.0:1787862610.192329:0:7622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862610.192335:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.192341:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf893027c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.192366:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862610.192368:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862610.192378:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862610.299565:0:11990:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862610.299577:0:11990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862610.299617:0:11990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787862610.299624:0:11990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862610.485526:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.485603:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516956288 00000100:00100000:2.0:1787862610.485620:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516956288 00000100:00100000:2.0:1787862610.485700:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:2.0:1787862610.485712:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+17:10448:x1874709516956288:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862610.485739:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862610.485761:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34797 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.486121:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893028a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.486150:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893028a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.486164:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893028a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862610.486178:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787862610.486373:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34797 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.486393:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893028a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34797 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.486402:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862610.486405:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862610.486409:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:2.0:1787862610.486484:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+19:10448:x1874709516956288:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 775us (976us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787862610.486492:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:2.0:1787862610.493493:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.493594:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516956416 00000100:00100000:3.0:1787862610.493607:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516956416 00000100:00100000:3.0:1787862610.493681:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862610.493694:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:10448:x1874709516956416:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:3.0:1787862610.493800:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.493818:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.493830:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.493843:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.493848:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.493852:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494230:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494248:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494255:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862610.494325:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494347:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494355:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494362:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494369:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.494375:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494384:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494398:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:3.0:1787862610.494401:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862610.494408:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494415:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930298 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494427:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494432:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494444:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494449:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.494452:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494459:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494467:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517c53100) 00010000:00010000:3.0:1787862610.494470:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862610.494473:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494479:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf893029f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494494:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494502:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494508:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494514:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422cc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862610.494517:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494538:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494547:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6517c53f00) 00010000:00010000:3.0:1787862610.494549:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862610.494552:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.494558:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf89302a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.494812:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:10448:x1874709516956416:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 1118us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862610.494823:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00010000:00010000:3.0:1787862610.529456:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862610.588767:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.588829:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516956672 00000100:00100000:1.0:1787862610.588841:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516956672 00000100:00100000:1.0:1787862610.588909:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:1.0:1787862610.588920:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+19:10451:x1874709516956672:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862610.588948:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862610.588977:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3479e expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589108:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589126:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589139:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589156:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589163:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589171:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589555:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589564:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589572:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862610.589583:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787862610.589696:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589703:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589716:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589723:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.589728:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589738:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589752:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862610.589756:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862610.589761:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589768:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89302b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589782:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589788:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589794:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589799:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.589802:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589818:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589827:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880000) 00010000:00010000:1.0:1787862610.589829:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862610.589833:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589839:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89302bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589890:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 22 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589906:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 21 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.589915:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862610.589917:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862610.589920:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45800, rc 0) 00000100:00100000:1.0:1787862610.590013:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+21:10451:x1874709516956672:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1093us (1263us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787862610.590023:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:0.0:1787862610.595841:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.596018:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516956800 00000100:00100000:1.0:1787862610.596031:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516956800 00000100:00100000:1.0:1787862610.596362:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:1.0:1787862610.596375:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:10451:x1874709516956800:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:1.0:1787862610.596491:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596512:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596527:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596561:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596569:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596577:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596584:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.596589:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596598:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596613:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862610.596617:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862610.596623:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.596629:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.598501:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:10451:x1874709516956800:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 2114us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862610.598520:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:1.0:1787862610.601184:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.601275:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516957056 00000100:00100000:3.0:1787862610.601288:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516957056 00000100:00100000:3.0:1787862610.601933:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:3.0:1787862610.601946:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:10451:x1874709516957056:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862610.602294:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+22:10451:x1874709516957056:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 350us (1121us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787862610.602303:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862610.647372:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.647524:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516957312 00000100:00100000:1.0:1787862610.647538:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516957312 00000100:00100000:1.0:1787862610.647665:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:1.0:1787862610.648476:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+22:9979:x1874709516957312:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862610.648518:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862610.648551:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347a5 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.648918:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.648935:0:7147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 23 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.648946:0:7147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.648990:0:7147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 23 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.649008:0:7147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 23 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.649202:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526420096:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862610.650452:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862610.654003:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526420096:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862610.654099:0:7147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.654410:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.654919:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516957440 00000100:00100000:3.0:1787862610.654928:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516957440 00010000:00010000:3.0:1787862610.655272:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 24 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.655379:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:3.0:1787862610.655389:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+24:2349:x1874709516957440:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862610.655402:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862610.655430:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 24 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.655442:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 24 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.655466:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89302c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3479e expref: 24 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.655484:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:3.0:1787862610.655489:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.655499:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.655507:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.655538:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862610.655654:0:7147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.655661:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862610.655685:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787862610.655821:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89302d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 25 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.655833:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 24 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.655838:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:2.0:1787862610.655840:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862610.655842:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44800, rc 0) 00000100:00100000:3.0:1787862610.655894:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+24:2349:x1874709516957440:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 507us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862610.655901:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:2.0:1787862610.656914:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+23:9979:x1874709516957312:12345-192.168.202.60@tcp:101:bash.0 Request processed in 8454us (9556us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787862610.656923:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:3.0:1787862610.660831:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.669427:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516957696 00000100:00100000:1.0:1787862610.669444:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516957696 00000100:00100000:0.0:1787862610.669963:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:0.0:1787862610.669975:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+23:9979:x1874709516957696:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:0.0:1787862610.670417:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.670437:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.670461:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862610.670529:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787862610.670554:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa3209b7 reply state 00000000b3df90a5 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862610.670561:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787862610.670642:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787862610.670748:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+27:9979:x1874709516957696:12345-192.168.202.60@tcp:36:bash.0 Request processed in 774us (9930us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787862610.670753:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 89 00000020:00080000:0.0:1787862610.670757:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787862610.674618:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.674637:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.674645:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.674649:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862610.674653:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.674659:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.674679:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:2.0:1787862610.674682:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862610.674699:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.674704:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89302ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.676904:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.676986:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516957824 00000100:00100000:2.0:1787862610.676998:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516957824 00000100:00100000:2.0:1787862610.677272:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:2.0:1787862610.677284:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+26:9979:x1874709516957824:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862610.677310:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862610.677331:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89302f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347ac expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.677396:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89302f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347ac expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.677411:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89302f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347ac expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.677431:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:2.0:1787862610.677434:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862610.677438:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:2.0:1787862610.677594:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+27:9979:x1874709516957824:12345-192.168.202.60@tcp:101:bash.0 Request processed in 311us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862610.677602:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:0.0:1787862610.688026:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.689719:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516957952 00000100:00100000:2.0:1787862610.689735:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516957952 00000100:00100000:2.0:1787862610.689806:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:2.0:1787862610.689833:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:9979:x1874709516957952:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862610.689853:0:11687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862610.689876:0:11687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347b3 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862610.689906:0:11687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a909e50, atime: 0x6a909e4e, ctime: 0x6a909e50, blocks: 0xb 00010000:00010000:2.0:1787862610.689930:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1787862610.689934:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862610.689943:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 7 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.689960:0:11687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 7 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.689973:0:11687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:2.0:1787862610.690376:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:9979:x1874709516957952:12345-192.168.202.60@tcp:101:bash.0 Request processed in 544us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862610.690384:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:2.0:1787862610.695411:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.695534:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516958080 00000100:00100000:1.0:1787862610.695543:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516958080 00002000:00010000:1.0:1787862610.695703:0:6675:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787862610.695709:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65344ca580 with x1874709516958080 ext(0->18446744073709551615) 00002000:00010000:1.0:1787862610.695722:0:6675:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a65344ca580. 00000100:00100000:1.0:1787862610.695758:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:1.0:1787862610.695770:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516958080:12345-192.168.202.60@tcp:10:bash.0 00002000:00010000:2.0:1787862610.696535:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787862610.696541:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787862608 -> 1787862610 00002000:00010000:2.0:1787862610.696543:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787862606 -> 1787862606 00002000:00010000:2.0:1787862610.696546:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787862608 -> 1787862610 00002000:00010000:2.0:1787862610.696549:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787862610.696792:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516958080:12345-192.168.202.60@tcp:10:bash.0 Request processed in 1022us (1390us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787862610.696820:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00002000:00010000:2.0:1787862610.696825:0:6675:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787862610.696828:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65344ca580 with x1874709516958080 ext(0->18446744073709551615) 00002000:00010000:2.0:1787862610.696833:0:6675:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a65344ca580. 00000100:00100000:2.0:1787862610.756793:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862610.756984:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516958208 00000100:00100000:0.0:1787862610.757296:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516958208 00000100:00100000:0.0:1787862610.757368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:0.0:1787862610.757381:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+27:10465:x1874709516958208:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:0.0:1787862610.757707:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.757723:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.757732:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.757744:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.757763:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.757767:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758502:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758514:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758521:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862610.758560:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758664:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758670:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758674:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758678:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862610.758681:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758687:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758704:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:0.0:1787862610.758706:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862610.758709:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758713:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf8930301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758723:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758726:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758729:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758732:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862610.758734:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758737:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758741:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517dfc500) 00010000:00010000:0.0:1787862610.758742:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862610.758744:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758747:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758763:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758767:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758770:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758773:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862610.758774:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758778:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758781:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:0.0:1787862610.758782:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862610.758784:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862610.758787:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893030f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862610.758858:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+27:10465:x1874709516958208:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 1479us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862610.758864:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:0.0:1787862610.823749:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.824808:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516958464 00000100:00100000:1.0:1787862610.824822:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516958464 00000100:00100000:1.0:1787862610.824958:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:1.0:1787862610.824970:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+27:10468:x1874709516958464:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862610.825006:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862610.825037:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347ba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825151:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825185:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825197:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825224:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825241:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825249:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825603:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf893032b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825614:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf893032b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825622:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf893032b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862610.825632:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787862610.825725:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825734:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825741:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825753:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.825758:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825766:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825779:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862610.825783:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862610.825788:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825795:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893031d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825808:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825814:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825821:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825826:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.825829:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825835:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825851:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880000) 00010000:00010000:1.0:1787862610.825854:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862610.825857:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825864:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825902:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347ba expref: 30 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825915:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf893032b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347ba expref: 29 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.825923:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862610.825926:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787862610.825928:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45200, rc 0) 00000100:00100000:1.0:1787862610.826006:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+29:10468:x1874709516958464:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1038us (2440us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787862610.826014:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:2.0:1787862610.834922:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862610.835081:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516958592 00000100:00100000:1.0:1787862610.835095:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516958592 00000100:00100000:1.0:1787862610.835185:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:1.0:1787862610.835197:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:10468:x1874709516958592:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:1.0:1787862610.835302:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.835324:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 29 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.835349:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.835399:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 29 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.835416:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 29 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.835436:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526420224:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862610.835567:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193300 going to sleep for 11 seconds 00000100:00100000:0.0:1787862610.840973:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.841084:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516958848 00000100:00100000:2.0:1787862610.841098:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516958848 00000100:00100000:2.0:1787862610.841190:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:2.0:1787862610.841204:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+30:5589:x1874709516958848:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787862610.842108:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+31:5589:x1874709516958848:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 900us (1142us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787862610.842121:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787862610.842554:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526420224:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862610.842590:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.847749:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862610.847931:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516958976 00000100:00100000:3.0:1787862610.847951:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516958976 00010000:00010000:3.0:1787862610.848004:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 31 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862610.848115:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1787862610.848126:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+31:2348:x1874709516958976:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862610.848145:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862610.848152:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 31 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.848312:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 31 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.848345:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf89302de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347a5 expref: 31 pid: 7147 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.848369:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:3.0:1787862610.848376:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.848387:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.848395:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862610.848431:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862610.848497:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+30:2348:x1874709516958976:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 373us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862610.848504:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00010000:00010000:1.0:1787862610.848692:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848702:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848745:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848752:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848760:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848775:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.848781:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848789:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848798:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862610.848800:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862610.848804:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.848811:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862610.848853:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:10468:x1874709516958592:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 13659us (13947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862610.848861:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:0.0:1787862610.853543:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.853960:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516959232 00000100:00100000:2.0:1787862610.853976:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516959232 00000100:00100000:2.0:1787862610.854089:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:2.0:1787862610.854102:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+29:10468:x1874709516959232:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787862610.854452:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+30:10468:x1874709516959232:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 351us (926us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787862610.854461:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862610.931356:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.932937:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516959488 00000100:00100000:2.0:1787862610.932960:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516959488 00000100:00100000:1.0:1787862610.933191:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:1.0:1787862610.933209:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+30:10479:x1874709516959488:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:1.0:1787862610.933254:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862610.933285:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347c1 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.933403:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.933423:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.933457:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.933475:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.933483:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.933489:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936014:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936067:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936084:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862610.936099:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787862610.936260:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936268:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936276:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936283:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.936306:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936315:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936331:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862610.936334:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862610.936341:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936348:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930347 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936367:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936373:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936378:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936864:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862610.936869:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936877:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936888:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880000) 00010000:00010000:1.0:1787862610.936891:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862610.936904:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936912:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893034e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.936989:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c1 expref: 33 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.937009:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c1 expref: 32 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.937018:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862610.937020:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862610.937023:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44c00, rc 0) 00000100:00100000:1.0:1787862610.937185:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+32:10479:x1874709516959488:12345-192.168.202.60@tcp:101:cat.0 Request processed in 3979us (5845us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787862610.937197:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:1.0:1787862610.942787:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.942930:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516959744 00000100:00100000:2.0:1787862610.942943:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516959744 00000100:00100000:2.0:1787862610.943037:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1787862610.943101:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+32:10479:x1874709516959744:12345-192.168.202.60@tcp:35:cat.0 00000100:00100000:2.0:1787862610.943445:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+33:10479:x1874709516959744:12345-192.168.202.60@tcp:35:cat.0 Request processed in 348us (673us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787862610.943453:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787862610.976218:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862610.976435:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516960000 00000100:00100000:2.0:1787862610.976450:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516960000 00000100:00100000:2.0:1787862610.976537:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:2.0:1787862610.976550:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+33:10480:x1874709516960000:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:2.0:1787862610.976638:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787862610.976674:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c1 expref: 33 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976706:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf893032b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347ba expref: 32 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976721:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf89302f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347ac expref: 31 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976744:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6516880200) 00010000:00010000:2.0:1787862610.976760:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862610.976789:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976806:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976816:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976849:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976856:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.976862:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.977367:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.977379:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.977388:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862610.978093:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787862610.978107:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336742063327ns, next at 337742059278ns, rc = 0 00010000:00010000:2.0:1787862610.978394:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978410:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978421:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978429:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978450:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978457:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978487:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862610.978517:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978523:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978529:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978536:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862610.978541:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978550:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978563:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6400) 00010000:00010000:2.0:1787862610.978566:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787862610.978571:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978578:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930371 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978601:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978613:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978619:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978625:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862610.978629:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978635:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978644:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862610.978646:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862610.978650:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.978656:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8930363 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862610.978676:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd07edde reply state 00000000ed658176 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862610.978686:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862610.978811:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+32:10480:x1874709516960000:12345-192.168.202.60@tcp:36:rm.0 Request processed in 2259us (2629us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787862610.978821:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 95 00010000:00010000:1.0:1787862610.980024:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862610.980159:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.980172:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862610.980177:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.980188:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.980207:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6507fe6400) 00010000:00010000:1.0:1787862610.980227:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862610.980242:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.980250:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930378 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862610.980291:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862610.980294:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862610.980295:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862610.985128:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.985185:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.985194:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.985200:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862610.985205:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.985340:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.985365:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6507fe6300) 00010000:00010000:2.0:1787862610.985369:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862610.985376:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862610.985631:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893036a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862611.033147:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.033811:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516960256 00000100:00100000:2.0:1787862611.033826:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516960256 00000100:00100000:1.0:1787862611.034120:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:1.0:1787862611.034135:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+31:10486:x1874709516960256:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862611.034184:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.034217:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf893037f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347c8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.034521:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.034542:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.034557:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.034574:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.034583:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.034590:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862611.036703:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787862611.036998:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037018:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037030:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037097:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037106:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037113:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037120:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.037125:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037134:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037149:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862611.037153:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862611.037158:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037182:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930386 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862611.037199:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000847541fb reply state 0000000097e06041 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.037210:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787862611.037269:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf893037f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 34 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037287:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.037296:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862611.037299:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862611.037302:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44800, rc 0) 00000100:00100000:1.0:1787862611.037432:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+34:10486:x1874709516960256:12345-192.168.202.60@tcp:101:bash.0 Request processed in 3301us (4302us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787862611.037444:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 96 00010000:00010000:2.0:1787862611.042215:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.042250:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.042259:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.042291:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862611.042298:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.042308:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.042329:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880000) 00010000:00010000:2.0:1787862611.042333:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862611.042339:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.042346:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf893038d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.048410:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.048475:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516960384 00000100:00100000:2.0:1787862611.048489:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516960384 00000100:00100000:2.0:1787862611.048601:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:2.0:1787862611.048615:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516960384:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862611.048643:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862611.048678:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347cf expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862611.048720:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787862611.048748:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1787862611.048753:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862611.048766:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.048815:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.048832:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd200, rc 0) 00000100:00100000:2.0:1787862611.048917:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516960384:12345-192.168.202.60@tcp:101:bash.0 Request processed in 306us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.048925:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00080000:0.0:1787862611.049011:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862611.053314:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.053488:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516960512 00000100:00100000:1.0:1787862611.053502:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516960512 00000100:00100000:1.0:1787862611.053616:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:1.0:1787862611.053629:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:10486:x1874709516960512:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862611.053653:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.053688:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.057618:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.057631:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862611.057637:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862611.057644:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.057712:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.057734:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.057756:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1874709526420352:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862611.057913:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862611.061465:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6672:1874709526420352:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862611.061517:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.061547:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44a00, rc 0) 00000100:00100000:1.0:1787862611.061635:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:10486:x1874709516960512:12345-192.168.202.60@tcp:101:bash.0 Request processed in 8007us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.061647:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:3.0:1787862611.063999:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.064075:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516960640 00000100:00100000:1.0:1787862611.064088:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516960640 00010000:00010000:1.0:1787862611.064141:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.064191:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:1.0:1787862611.064201:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516960640:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862611.064222:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862611.064266:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.064283:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.064314:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347cf expref: 7 pid: 6671 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.064345:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862611.064350:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862611.064361:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.064374:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.064502:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.064529:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1874709526420480:192.168.202.60@tcp:105: 00000100:00100000:1.0:1787862611.064715:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862611.070970:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1874709526420480:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787862611.071006:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862611.071104:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516960640:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 6904us (7115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.071118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:2.0:1787862611.084009:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862611.084240:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516960896 00000100:00100000:0.0:1787862611.084253:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516960896 00000100:00100000:0.0:1787862611.084327:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:0.0:1787862611.084340:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+33:10486:x1874709516960896:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:0.0:1787862611.084853:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+34:10486:x1874709516960896:12345-192.168.202.60@tcp:35:bash.0 Request processed in 513us (857us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787862611.084862:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1787862611.322720:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.322889:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516961024 00000100:00100000:1.0:1787862611.322898:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516961024 00000100:00100000:1.0:1787862611.322971:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:1.0:1787862611.322981:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+34:10502:x1874709516961024:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862611.323005:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.323026:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89303b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347dd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.323127:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89303b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.323142:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89303b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.323156:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89303b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862611.323217:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787862611.323222:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862611.323281:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89303b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.323307:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89303b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347dd expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.323327:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89303b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347dd expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.323335:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862611.323338:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862611.323342:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45800, rc 0) 00000100:00100000:1.0:1787862611.323413:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+35:10502:x1874709516961024:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 434us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.323420:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:2.0:1787862611.330771:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.330866:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516961280 00000100:00100000:1.0:1787862611.330884:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516961280 00000100:00100000:1.0:1787862611.330990:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:1.0:1787862611.331001:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+35:10502:x1874709516961280:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862611.331023:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.331072:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89303be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347e4 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.331192:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89303c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.331208:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89303c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.331219:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89303c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862611.331260:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787862611.331420:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89303be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347e4 expref: 38 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.331441:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89303c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347e4 expref: 37 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.331449:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862611.331451:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862611.331457:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45200, rc 0) 00000100:00100000:1.0:1787862611.331914:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+37:10502:x1874709516961280:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 912us (1150us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787862611.332084:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:3.0:1787862611.342962:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.343009:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862611.343184:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516961664 00000100:00100000:0.0:1787862611.343196:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516961664 00000100:00100000:0.0:1787862611.343276:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787862611.343287:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+37:2349:x1874709516961664:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862611.343303:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862611.343328:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89303c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347e4 expref: 37 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.343347:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:0.0:1787862611.343352:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862611.343403:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+36:2349:x1874709516961664:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862611.343411:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:1.0:1787862611.344921:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516961536 00000100:00100000:1.0:1787862611.344941:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516961536 00000100:00100000:1.0:1787862611.344993:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:1.0:1787862611.345002:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+36:10502:x1874709516961536:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862611.345024:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.345075:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89303d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347eb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.345204:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.345218:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.345514:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862611.345527:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787862611.345647:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf89303d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347eb expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.345665:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347eb expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.345684:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862611.345687:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862611.345690:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44c00, rc 0) 00000100:00100000:1.0:1787862611.345882:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+38:10502:x1874709516961536:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 881us (2929us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787862611.345889:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:3.0:1787862611.377003:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.377118:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516961792 00000100:00100000:2.0:1787862611.377128:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516961792 00000100:00100000:2.0:1787862611.377201:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:2.0:1787862611.377222:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516961792:12345-192.168.202.60@tcp:1:lfs.0 00010000:00010000:2.0:1787862611.377278:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.377300:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.377309:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787862611.377314:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862611.377318:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.377354:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.377384:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 6 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862611.377397:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6671:1874709526420608:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862611.378187:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a14a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862611.391492:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.392281:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6671:1874709526420608:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862611.392310:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862611.392775:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516961920 00000100:00100000:0.0:1787862611.392784:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516961920 00002000:00100000:0.0:1787862611.392848:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a6401b3cf00 x1874709516961920/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:727/0 lens 504/0 e 0 to 0 dl 1787862622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862611.392858:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6401b3cf00 with x1874709516961920 ext(0->8) 00010000:00010000:0.0:1787862611.392867:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 7 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.392894:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 7 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862611.392901:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a6401b3cf00 00000100:00100000:3.0:1787862611.393080:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787862611.393093:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516961920:12345-192.168.202.60@tcp:4:lfs.0 00000100:00100000:3.0:1787862611.393838:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:2348:x1874709516961920:12345-192.168.202.60@tcp:4:lfs.0 Request processed in 745us (2352us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787862611.393847:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00002000:00100000:3.0:1787862611.393854:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a6401b3cf00 x1874709516961920/t4294967302(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:727/0 lens 504/448 e 0 to 0 dl 1787862622 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862611.393862:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6401b3cf00 with x1874709516961920 ext(0->8) 00010000:00010000:3.0:1787862611.393869:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 9 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.394319:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 9 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862611.394328:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a6401b3cf00 00000100:00100000:0.0:1787862611.397396:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.397540:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516962048 00000100:00100000:3.0:1787862611.397552:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516962048 00010000:00010000:3.0:1787862611.397595:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 9 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.397640:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:3.0:1787862611.397650:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:2347:x1874709516962048:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862611.397688:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787862611.397708:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787862611.397711:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787862611 00002000:00010000:3.0:1787862611.397713:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787862611 00002000:00010000:3.0:1787862611.397715:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787862611 00010000:00010000:3.0:1787862611.397722:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 9 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.397737:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 9 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.397765:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000480f9092/0x9c5536ccf89303a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347d6 expref: 9 pid: 6672 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.397785:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862611.397790:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862611.397796:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.397806:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.397845:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862611.397920:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709516962048:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 270us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.397935:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00010000:00010000:2.0:1787862611.399453:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399473:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399508:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399517:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399524:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399548:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862611.399553:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399562:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399581:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.399589:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf89303e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862611.399701:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709516961792:12345-192.168.202.60@tcp:1:lfs.0 Request processed in 22487us (22706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.399709:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:0.0:1787862611.406180:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.406352:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516962304 00000100:00100000:3.0:1787862611.406362:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516962304 00000100:00100000:3.0:1787862611.406425:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:3.0:1787862611.406436:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+38:10502:x1874709516962304:12345-192.168.202.60@tcp:35:lfs.0 00000004:00010000:3.0:1787862611.406501:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347eb expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862611.406758:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787862611.406796:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787862611.407454:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787862611.407513:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.407530:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.407539:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.407571:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.407585:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 42 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.407599:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f896d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874709526420736:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862611.411104:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862611.414601:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.414803:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516962432 00000100:00100000:3.0:1787862611.414813:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516962432 00010000:00010000:3.0:1787862611.414857:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 43 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.414918:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:3.0:1787862611.414936:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+43:2349:x1874709516962432:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862611.414955:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862611.414962:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 43 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.414976:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 43 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.415000:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:3.0:1787862611.415006:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.415016:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.415024:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.415076:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862611.415129:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+43:2349:x1874709516962432:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 196us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.415137:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00010000:00010000:1.0:1787862611.417443:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347c8 expref: 42 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.417466:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f896d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874709526420736:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862611.417489:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.417499:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.417523:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862611.417649:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787862611.418198:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787862611.418332:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526420864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787862611.418398:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862611.418435:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862611.418509:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526420864 00000100:00100000:3.0:1787862611.418516:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526420864 00000100:00100000:3.0:1787862611.418571:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862611.418581:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1874709526420864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787862611.418916:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1874709526420864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 336us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.418924:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862611.419240:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526420864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787862611.420140:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787862611.420240:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526420992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787862611.420296:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862611.420387:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862611.420433:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526420992 00000100:00100000:2.0:1787862611.420440:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526420992 00000100:00100000:2.0:1787862611.421382:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787862611.421398:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511543840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5818:x1874709526420992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787862611.422187:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511543840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5818:x1874709526420992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 792us (1887us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787862611.422198:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862611.422357:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526420992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787862611.422448:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787862611.422501:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.422511:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.422518:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.422524:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.422528:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.422552:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.422569:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862611.422572:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787862611.422577:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.422583:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf89303ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862611.423184:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787862611.423299:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787862611.423312:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337187268224ns, next at 338187265752ns, rc = 0 00000001:00080000:1.0:1787862611.423318:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787862611.423353:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6516880200) 00010000:00010000:1.0:1787862611.423356:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862611.423365:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347eb expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.423814:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+45:10502:x1874709516962304:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 17378us (17653us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787862611.423824:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000020:00080000:1.0:1787862611.423829:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787862611.427133:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.427571:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516962560 00000100:00100000:2.0:1787862611.427601:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516962560 00000100:00100000:2.0:1787862611.433497:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:2.0:1787862611.433526:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+45:10502:x1874709516962560:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862611.433555:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862611.433583:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89303f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347f2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.433650:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89303f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f2 expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.433675:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89303f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f2 expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.433695:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862611.433698:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862611.433702:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc000, rc 0) 00000100:00100000:2.0:1787862611.438507:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+46:10502:x1874709516962560:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 4982us (11370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.438520:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:2.0:1787862611.442682:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862611.442856:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516962816 00000100:00100000:0.0:1787862611.442866:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516962816 00000100:00100000:0.0:1787862611.443038:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:0.0:1787862611.443068:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+46:10502:x1874709516962816:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862611.443338:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+47:10502:x1874709516962816:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 273us (677us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787862611.443346:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00010000:00010000:3.0:1787862611.548360:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862611.602299:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.602413:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516962944 00000100:00100000:1.0:1787862611.602425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516962944 00000100:00100000:1.0:1787862611.602494:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:1.0:1787862611.602506:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+47:10512:x1874709516962944:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:1.0:1787862611.602611:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602630:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602641:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602655:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602674:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602682:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602801:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602809:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602816:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862611.602859:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602872:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.602900:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605149:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605172:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.605179:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605190:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605208:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862611.605211:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862611.605217:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605234:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf89303fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605257:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605264:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605271:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605277:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.605300:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605307:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605315:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880200) 00010000:00010000:1.0:1787862611.605317:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862611.605321:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605326:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605345:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605351:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605357:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605362:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.605365:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605371:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605379:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862611.605381:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862611.605391:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.605397:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893040b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.605525:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+47:10512:x1874709516962944:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 3016us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.605535:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:3.0:1787862611.691776:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.691856:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516963200 00000100:00100000:1.0:1787862611.691867:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516963200 00000100:00100000:1.0:1787862611.692084:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787862611.692093:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+47:10515:x1874709516963200:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862611.692112:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.692129:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b347f9 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692198:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692212:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692223:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692256:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692264:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692292:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692440:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692449:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692456:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862611.692466:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787862611.692562:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692568:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692572:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692575:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.692579:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692584:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692592:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862611.692594:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862611.692604:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692611:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692624:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692629:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692635:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692641:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.692644:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692650:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692658:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6516880200) 00010000:00010000:1.0:1787862611.692660:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862611.692662:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.692665:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.693026:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf8930412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 50 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.693091:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 49 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.693098:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862611.693100:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862611.693103:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44a00, rc 0) 00000100:00100000:1.0:1787862611.693272:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+49:10515:x1874709516963200:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1178us (1505us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787862611.693280:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:3.0:1787862611.697465:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.697592:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516963328 00000100:00100000:1.0:1787862611.697602:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516963328 00000100:00100000:1.0:1787862611.697861:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:1.0:1787862611.697882:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+49:10515:x1874709516963328:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:1.0:1787862611.697960:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.697973:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.697983:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698009:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698016:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698034:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698064:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862611.698069:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698077:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698088:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862611.698091:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862611.698096:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.698102:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.698181:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+49:10515:x1874709516963328:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 309us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.698189:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:3.0:1787862611.700941:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862611.701079:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516963584 00000100:00100000:0.0:1787862611.701088:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516963584 00000100:00100000:0.0:1787862611.701140:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:0.0:1787862611.701149:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+49:10515:x1874709516963584:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862611.701419:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+50:10515:x1874709516963584:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 270us (491us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787862611.701427:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:3.0:1787862611.787678:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.787788:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516963840 00000100:00100000:2.0:1787862611.787798:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516963840 00000100:00100000:2.0:1787862611.787865:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:2.0:1787862611.787876:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+50:10525:x1874709516963840:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862611.787913:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862611.787917:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787862611.787952:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89303b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347dd expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.787988:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862611.787994:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862611.788008:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893043c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34800 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.788610:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.788627:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 50 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.788635:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.788668:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 50 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.788693:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 50 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.788707:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534649e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874709526421120:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862611.788802:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862611.795555:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.795637:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516963968 00000100:00100000:2.0:1787862611.795646:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516963968 00010000:00010000:2.0:1787862611.795700:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 51 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862611.795744:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:2.0:1787862611.795752:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+51:2348:x1874709516963968:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862611.795768:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862611.795773:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 51 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.795783:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 51 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.795801:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862611.795805:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.795813:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.795819:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.795851:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862611.795907:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+51:2348:x1874709516963968:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 153us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.795913:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00010000:00010000:3.0:1787862611.796424:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f9 expref: 50 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.796456:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534649e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874709526421120:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862611.796483:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.796492:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.796497:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862611.796519:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787862611.796686:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893043c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.796702:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.796710:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862611.796714:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787862611.796716:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422cc00, rc 0) 00000100:00100000:3.0:1787862611.796764:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+50:10525:x1874709516963840:12345-192.168.202.60@tcp:101:bash.0 Request processed in 8890us (9104us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787862611.796772:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:0.0:1787862611.801030:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.801167:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516964224 00000100:00100000:2.0:1787862611.801177:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516964224 00000100:00100000:2.0:1787862611.801248:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:2.0:1787862611.801259:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+50:10525:x1874709516964224:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:2.0:1787862611.801535:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.801552:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.801562:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862611.801604:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787862611.801628:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000211a6914 reply state 00000000bb9b2efe transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862611.801637:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862611.801746:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+53:10525:x1874709516964224:12345-192.168.202.60@tcp:36:bash.0 Request processed in 489us (722us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787862611.801751:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 105 00000020:00080000:2.0:1787862611.801755:0:5816:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787862611.808931:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.808951:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.808959:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.808965:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862611.808971:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.808977:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.808991:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:0.0:1787862611.808993:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862611.808997:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862611.809001:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930451 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862611.811935:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.812024:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516964352 00000100:00100000:1.0:1787862611.812038:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516964352 00000100:00100000:1.0:1787862611.812137:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:1.0:1787862611.812146:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+52:10525:x1874709516964352:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862611.812166:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.812186:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34807 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.812323:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.812340:0:7147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.812350:0:7147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.812385:0:7147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.812401:0:7147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 53 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.812417:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511541a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526421248:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862611.812496:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862611.815375:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.815517:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516964480 00000100:00100000:3.0:1787862611.815525:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516964480 00010000:00010000:3.0:1787862611.815556:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 54 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.815605:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:3.0:1787862611.815615:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+54:2349:x1874709516964480:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862611.815631:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862611.815637:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 54 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.815650:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 54 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.815682:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862611.815688:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.815697:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.815705:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.815723:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862611.815774:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+54:2349:x1874709516964480:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 160us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.815783:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00010000:00010000:1.0:1787862611.816730:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930443 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34800 expref: 53 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.816751:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511541a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526421248:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862611.816773:0:7147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.816782:0:7147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.816802:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862611.816847:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787862611.816852:0:7147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862611.817034:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.817145:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 53 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.817160:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 52 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.817167:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862611.817169:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862611.817173:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45000, rc 0) 00000100:00100000:1.0:1787862611.817235:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+52:10525:x1874709516964352:12345-192.168.202.60@tcp:101:bash.0 Request processed in 5081us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.817244:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:2.0:1787862611.820590:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862611.820689:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516964736 00000100:00100000:0.0:1787862611.820713:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516964736 00000100:00100000:0.0:1787862611.820800:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:0.0:1787862611.820809:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+52:10525:x1874709516964736:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:0.0:1787862611.821033:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+53:10525:x1874709516964736:12345-192.168.202.60@tcp:35:bash.0 Request processed in 226us (453us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787862611.821039:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:3.0:1787862611.873859:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.874329:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516964864 00000100:00100000:2.0:1787862611.874352:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516964864 00000100:00100000:2.0:1787862611.874405:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:2.0:1787862611.874415:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+53:10531:x1874709516964864:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862611.874440:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862611.874826:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3480e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.875113:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893046d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.875126:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893046d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.875135:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893046d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862611.875187:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787862611.875191:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862611.875213:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893046d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.875265:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3480e expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.875285:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893046d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3480e expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.875292:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862611.875294:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862611.875297:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:2.0:1787862611.875366:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+54:10531:x1874709516964864:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 952us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.875374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:1.0:1787862611.878349:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.878399:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516964992 00000100:00100000:3.0:1787862611.878461:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516964992 00000100:00100000:3.0:1787862611.878516:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:3.0:1787862611.878540:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511541a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+54:10531:x1874709516964992:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862611.878561:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862611.878580:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34815 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878714:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878728:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878740:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878753:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878759:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878765:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878853:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878860:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878866:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862611.878918:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787862611.878929:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862611.878946:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878956:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878964:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878969:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878975:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878980:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862611.878984:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.878990:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879001:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:3.0:1787862611.879004:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862611.879008:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879014:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893047b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879039:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879071:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879078:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879083:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862611.879086:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879092:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879100:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517c53f00) 00010000:00010000:3.0:1787862611.879103:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862611.879106:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879111:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879141:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879154:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.879173:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862611.879175:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862611.879179:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422cc00, rc 0) 00000100:00100000:3.0:1787862611.879585:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511541a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+55:10531:x1874709516964992:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1046us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.879593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:3.0:1787862611.882869:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.883161:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516965248 00000100:00100000:1.0:1787862611.883171:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516965248 00000100:00100000:1.0:1787862611.883234:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:1.0:1787862611.883244:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+55:10531:x1874709516965248:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862611.883264:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862611.883287:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930490 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3481c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883424:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883439:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883448:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883456:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883493:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883507:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 56 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.883521:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511540780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526421376:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862611.883627:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.883637:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.883646:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526421504:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862611.883690:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862611.885930:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.886026:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516965376 00000100:00100000:2.0:1787862611.886035:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516965376 00010000:00010000:2.0:1787862611.886092:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 57 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862611.886139:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:2.0:1787862611.886149:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+57:2349:x1874709516965376:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862611.886166:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862611.886173:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 57 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.886186:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 57 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.886208:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862611.886213:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.886222:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.886238:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862611.886292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+57:2349:x1874709516965376:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 144us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.886300:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:0.0:1787862611.887824:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:1.0:1787862611.887917:0:5815:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.60@tcp) returned -22 from blocking AST (req@00000000b233f21a x1874709526421376) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 56 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.888033:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34815 expref: 56 pid: 5817 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862611.888072:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511540780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526421376:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862611.888087:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526421504:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862611.888109:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862611.888114:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.888122:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.888130:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.888270:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516965504 00000100:00100000:3.0:1787862611.888276:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516965504 00010000:00010000:3.0:1787862611.888302:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862611.888330:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:3.0:1787862611.888339:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+56:2349:x1874709516965504:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862611.888352:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862611.888357:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.888369:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.888385:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893045f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34807 expref: 56 pid: 7147 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.888393:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862611.888407:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.888415:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.888422:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.888515:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862611.888515:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.888521:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862611.888538:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:3.0:1787862611.888564:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+55:2349:x1874709516965504:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 226us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.888571:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00010000:00010000:1.0:1787862611.890839:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf8930490 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.890878:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.890886:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862611.890889:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862611.890892:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44800, rc 0) 00000100:00100000:1.0:1787862611.890963:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+55:10531:x1874709516965248:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 7720us (8103us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787862611.890970:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:2.0:1787862611.896642:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862611.896907:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516965760 00000100:00100000:3.0:1787862611.896917:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516965760 00000100:00100000:3.0:1787862611.896986:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1787862611.896996:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+55:10531:x1874709516965760:12345-192.168.202.60@tcp:103:lfs.0 00010000:00010000:3.0:1787862611.897012:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862611.897036:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89303f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347f2 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862611.897084:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862611.897090:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862611.897145:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+54:10531:x1874709516965760:12345-192.168.202.60@tcp:103:lfs.0 Request processed in 151us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862611.897153:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787862611.899534:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862611.899605:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516965888 00000100:00100000:1.0:1787862611.899613:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516965888 00000100:00100000:1.0:1787862611.899656:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 110 00000100:00100000:1.0:1787862611.899675:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+54:10531:x1874709516965888:12345-192.168.202.60@tcp:58:lfs.0 00010000:00010000:1.0:1787862611.899783:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.899797:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862611.899805:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862611.899988:0:7147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787862611.900094:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+54:10531:x1874709516965888:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 420us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862611.900101:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 110 00000100:00100000:0.0:1787862611.902181:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862611.902244:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966016 00000100:00100000:2.0:1787862611.902252:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966016 00000100:00100000:2.0:1787862611.902299:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 111 00000100:00100000:2.0:1787862611.902309:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+54:10531:x1874709516966016:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862611.902329:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862611.902349:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34823 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.902395:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.902404:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.902422:0:5816:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.902435:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.902500:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862611.902503:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862611.902507:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862611.902513:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd200, rc 0) 00000100:00100000:2.0:1787862611.902556:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+55:10531:x1874709516966016:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 249us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862611.902580:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 111 00000100:00100000:2.0:1787862612.174203:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862612.174308:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862612.174349:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.174417:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966144 00000100:00100000:1.0:1787862612.174447:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966144 00000100:00100000:1.0:1787862612.174505:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 298 00000100:00100000:1.0:1787862612.174516:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516966144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862612.174593:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516966144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.174600:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 298 00000100:00100000:3.0:1787862612.176821:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966272 00000100:00100000:3.0:1787862612.176835:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966272 00000100:00100000:3.0:1787862612.176928:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862612.176954:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2346:x1874709516966272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862612.177033:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2346:x1874709516966272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 83us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.177057:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862612.177158:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966400 00000100:00100000:3.0:1787862612.177163:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966400 00000100:00100000:3.0:1787862612.177193:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 156 00000100:00100000:3.0:1787862612.177200:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2346:x1874709516966400:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862612.177246:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2346:x1874709516966400:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 46us (2896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.177253:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 156 00000100:00080000:0.0:1787862612.179447:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862612.179459:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787862612.183525:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1787862612.183549:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787862612.183556:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:2.0:1787862612.252383:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862612.252397:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862612.255092:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787862612.255115:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862612.255290:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526421632:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787862612.255401:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a14780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862612.264900:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.265089:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966528 00000100:00100000:1.0:1787862612.265099:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966528 00000100:00100000:1.0:1787862612.265177:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:1.0:1787862612.265187:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516966528:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862612.265233:0:5815:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862612.265339:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516966528:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 153us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.265346:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00080000:0.0:1787862612.265656:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862612.266154:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526421632:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862612.269515:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.269701:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966656 00000100:00100000:3.0:1787862612.269711:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966656 00000100:00100000:3.0:1787862612.269777:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:3.0:1787862612.269789:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511542940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+55:10532:x1874709516966656:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787862612.269883:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.269905:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.269931:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270007:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270034:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270091:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270120:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270129:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270136:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862612.270179:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787862612.270184:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862612.270198:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270209:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270215:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270232:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270239:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862612.270244:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270259:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270273:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:3.0:1787862612.270275:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862612.270280:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270286:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89304b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270301:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270307:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270313:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270317:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862612.270320:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270325:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270331:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a6517c53100) 00010000:00010000:3.0:1787862612.270334:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862612.270337:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270354:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270369:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270374:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270380:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270386:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862612.270389:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270395:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270403:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862612.270405:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862612.270409:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.270414:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.270830:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511542940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+55:10532:x1874709516966656:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 1041us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.270840:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:1.0:1787862612.296314:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862612.296413:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516966912 00000100:00100000:0.0:1787862612.296426:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516966912 00000100:00100000:0.0:1787862612.296509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 114 00000100:00100000:0.0:1787862612.296520:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511540780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+55:10532:x1874709516966912:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862612.296544:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862612.296568:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89304c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3482a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.296671:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.296687:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.296699:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862612.296729:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787862612.296839:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.296847:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.296853:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.296859:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862612.296863:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.297135:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.297149:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:0.0:1787862612.297152:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787862612.297157:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.297164:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf89304cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.297209:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89304c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3482a expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.297231:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:0.0:1787862612.297234:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862612.297245:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf89304c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3482a expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.297256:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919a00, rc 0) 00000100:00100000:0.0:1787862612.297314:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511540780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516966912:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 796us (1011us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787862612.297322:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 114 00000100:00100000:0.0:1787862612.307243:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.308026:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516967040 00000100:00100000:1.0:1787862612.308038:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516967040 00000100:00100000:1.0:1787862612.308147:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:1.0:1787862612.308157:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516967040:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862612.308193:0:7147:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862612.308331:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516967040:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 174us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.308339:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:1.0:1787862612.315267:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.315365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516967296 00000100:00100000:3.0:1787862612.315377:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516967296 00000100:00100000:3.0:1787862612.315448:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 116 00000100:00100000:3.0:1787862612.315458:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516967296:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862612.315482:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862612.315485:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787862612.315513:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf893046d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3480e expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.315541:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:3.0:1787862612.315546:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862612.315561:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34831 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862612.316861:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787862612.317129:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.317146:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.317157:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.317229:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf89304dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34831 expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.317248:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34831 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.317274:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6517c53100) 00010000:00010000:3.0:1787862612.317277:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862612.317279:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d000, rc 0) 00000100:00100000:3.0:1787862612.320353:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+57:10532:x1874709516967296:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 4879us (5081us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787862612.320368:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 116 00000100:00100000:2.0:1787862612.339875:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.345201:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516967552 00000100:00100000:1.0:1787862612.345245:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516967552 00000100:00100000:1.0:1787862612.345402:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:1.0:1787862612.345414:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+57:10532:x1874709516967552:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.345481:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862612.345513:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf89304e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34831 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345533:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6517c53100) 00010000:00010000:1.0:1787862612.345543:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862612.345566:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345580:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345589:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345602:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345608:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345613:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345703:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345711:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345726:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345733:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.345737:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345745:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345753:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862612.345756:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862612.345759:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345764:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf89304f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345774:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345779:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345797:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345803:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af44a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.345805:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345822:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345830:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xda7fa1b (ffff9a6516880900) 00010000:00010000:1.0:1787862612.345833:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862612.345836:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.345843:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf89304f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda7fa1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.347361:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516967552:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 1938us (7488us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787862612.347374:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:0.0:1787862612.359798:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.359917:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516967680 00000100:00100000:1.0:1787862612.359935:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516967680 00000100:00100000:1.0:1787862612.360003:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:1.0:1787862612.360014:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:10532:x1874709516967680:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.360038:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862612.360106:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930500 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34838 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.360145:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.360160:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.360171:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.360295:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.360315:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.360324:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862612.360327:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787862612.360331:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45800, rc 0) 00000100:00100000:1.0:1787862612.360398:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+57:10532:x1874709516967680:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 385us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.360407:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:0.0:1787862612.373864:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.374017:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516967936 00000100:00100000:3.0:1787862612.374030:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516967936 00000100:00100000:3.0:1787862612.374136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 119 00000100:00100000:3.0:1787862612.374149:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+57:10532:x1874709516967936:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862612.374260:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.374278:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.374291:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862612.374557:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787862612.374569:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338138525443ns, next at 339138522216ns, rc = 0 00000004:00010000:3.0:1787862612.374675:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002288f5ca reply state 000000006a4ec2fc transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.374685:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862612.374782:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+59:10532:x1874709516967936:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 636us (930us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787862612.374807:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 119 00010000:00010000:0.0:1787862612.377078:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.377097:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.377105:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.377112:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862612.377117:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.377126:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.377144:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:0.0:1787862612.377147:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787862612.377153:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.377178:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf893050e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.381291:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.381368:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516968064 00000100:00100000:1.0:1787862612.381379:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516968064 00000100:00100000:1.0:1787862612.381441:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 120 00000100:00100000:1.0:1787862612.381452:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+58:10532:x1874709516968064:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.381479:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862612.381500:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3483f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.381577:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.381593:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.381628:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862612.381631:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862612.381635:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44a00, rc 0) 00000100:00100000:1.0:1787862612.381715:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+59:10532:x1874709516968064:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 264us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.381722:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 120 00000100:00100000:2.0:1787862612.387427:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.387572:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516968192 00000100:00100000:1.0:1787862612.387582:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516968192 00000100:00100000:1.0:1787862612.387642:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:1.0:1787862612.387654:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2346:x1874709516968192:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787862612.388698:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:2346:x1874709516968192:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 1041us (1277us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787862612.388710:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:0.0:1787862612.391724:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.391816:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516968448 00000100:00100000:3.0:1787862612.391827:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516968448 00000100:00100000:3.0:1787862612.391888:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:3.0:1787862612.391898:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+59:10532:x1874709516968448:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787862612.392229:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+60:10532:x1874709516968448:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 321us (506us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787862612.392237:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:1.0:1787862612.395424:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862612.395538:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516968704 00000100:00100000:2.0:1787862612.395551:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516968704 00000100:00100000:2.0:1787862612.395615:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:2.0:1787862612.395626:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511543c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+60:10532:x1874709516968704:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787862612.395756:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511543c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+60:10532:x1874709516968704:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862612.395764:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:2.0:1787862612.399514:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.399611:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516968832 00000100:00100000:1.0:1787862612.399621:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516968832 00000100:00100000:1.0:1787862612.399736:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:1.0:1787862612.399748:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+60:10532:x1874709516968832:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.399782:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862612.399808:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893051c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34846 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.399894:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.399911:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.399935:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862612.399997:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862612.400019:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.400090:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45000/0x9c5536ccf893051c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34846 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.400111:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34846 expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.400121:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862612.400124:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787862612.400128:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af44c00, rc 0) 00000100:00100000:1.0:1787862612.400193:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+61:10532:x1874709516968832:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 447us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.400200:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:0.0:1787862612.405420:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.405571:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516968960 00000100:00100000:3.0:1787862612.405582:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516968960 00000100:00100000:3.0:1787862612.405648:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:3.0:1787862612.405666:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516968960:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862612.405688:0:11687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862612.405711:0:11687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3484d expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862612.405736:0:11687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909e54, blocks: 0x1 00010000:00010000:3.0:1787862612.405757:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1787862612.405762:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862612.405771:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 10 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.405791:0:11687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 10 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.405824:0:11687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c000, rc 0) 00000100:00100000:3.0:1787862612.406308:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+10:2349:x1874709516968960:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 649us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.406317:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:0.0:1787862612.410714:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862612.410808:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969216 00000100:00100000:2.0:1787862612.410833:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969216 00000100:00100000:2.0:1787862612.410898:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:2.0:1787862612.410909:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+61:10532:x1874709516969216:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787862612.411088:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+61:10532:x1874709516969216:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 180us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862612.411097:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:2.0:1787862612.416574:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.416664:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969344 00000100:00100000:1.0:1787862612.416672:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969344 00000100:00100000:1.0:1787862612.416726:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787862612.416735:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+10:10532:x1874709516969344:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.416753:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862612.416771:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34854 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.416801:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.416831:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862612.416835:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862612.416841:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.416873:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.416886:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.416901:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1874709526421760:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862612.417011:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193600 going to sleep for 11 seconds 00000100:00100000:1.0:1787862612.420392:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6671:1874709526421760:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862612.420434:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.420458:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a650af45000, rc 0) 00000100:00100000:1.0:1787862612.420522:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+11:10532:x1874709516969344:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 3787us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.420533:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:2.0:1787862612.425542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.425647:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969472 00000100:00100000:3.0:1787862612.425670:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969472 00010000:00010000:3.0:1787862612.425724:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.425773:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:3.0:1787862612.425784:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+11:2348:x1874709516969472:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862612.425802:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862612.425825:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.425841:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.425866:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf893052a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3484d expref: 11 pid: 11687 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.425884:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862612.425889:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862612.425898:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.425937:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.425978:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.425993:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653464b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874709526421888:192.168.202.60@tcp:105: 00000100:00100000:3.0:1787862612.426133:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc42b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862612.432769:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.432907:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653464b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874709526421888:192.168.202.60@tcp:105: 00010000:00010000:3.0:1787862612.432946:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862612.433011:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+10:2348:x1874709516969472:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 7228us (7486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.433023:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:0.0:1787862612.433292:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969600 00000100:00100000:0.0:1787862612.433300:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969600 00002000:00100000:0.0:1787862612.433347:0:6675:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a65344cb0c0 x1874709516969600/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:728/0 lens 504/0 e 0 to 0 dl 1787862623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862612.433357:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65344cb0c0 with x1874709516969600 ext(0->12) 00002000:00010000:0.0:1787862612.433362:0:6675:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a65344cb0c0 00000100:00100000:0.0:1787862612.433393:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:0.0:1787862612.433403:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+10:2348:x1874709516969600:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787862612.433862:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+12:2348:x1874709516969600:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 Request processed in 459us (1103us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787862612.433870:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00002000:00100000:0.0:1787862612.433878:0:6675:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a65344cb0c0 x1874709516969600/t4294967308(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:728/0 lens 504/448 e 0 to 0 dl 1787862623 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787862612.433886:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65344cb0c0 with x1874709516969600 ext(0->12) 00002000:00010000:0.0:1787862612.433896:0:6675:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a65344cb0c0 00000100:00100000:2.0:1787862612.436729:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.436816:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969728 00000100:00100000:3.0:1787862612.436826:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969728 00000100:00100000:3.0:1787862612.436893:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 124 00000100:00100000:3.0:1787862612.436906:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+61:10532:x1874709516969728:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787862612.489897:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:1.0:1787862612.489938:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787862612.489962:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6508193000 refcount 2 committed 0 result 0 batchid 3 00000100:00100000:3.0:1787862612.489982:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+48:10532:x1874709516969728:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 53063us (53249us total) trans 0 rc 0/0 00000020:00080000:1.0:1787862612.489983:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a650ad49300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a65081936c0 00000020:00080000:1.0:1787862612.489987:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a650ad49600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a651fa5c000 00000100:00100000:3.0:1787862612.489993:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 124 00000020:00080000:1.0:1787862612.490018:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a640327b600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787862612.490022:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a651f8b7c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a65169a8e40 00000020:00080000:1.0:1787862612.490025:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a651f8b7900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a65030f1c00 00000004:00080000:1.0:1787862612.490062:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1787862612.490089:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787862612.490094:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787862612.490117:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1787862612.490149:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1787862612.490283:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511542d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526422016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787862612.490342:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787862612.490367:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787862612.490379:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862612.490382:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526422016 00000100:00100000:1.0:1787862612.490384:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526422144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787862612.490389:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526422016 00000100:00100000:1.0:1787862612.490416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862612.490440:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526422144 00000100:00100000:3.0:1787862612.490444:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526422144 00000100:00100000:3.0:1787862612.490466:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787862612.490474:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1874709526422016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787862612.490500:0:11687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787862612.490528:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.490564:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787862612.490573:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1874709526422144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787862612.490634:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862612.490644:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526422272:0@lo:6:osp-syn-1-0.0 00002000:00010000:1.0:1787862612.490692:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787862612.490696:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787862612 00002000:00010000:1.0:1787862612.490698:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862612.490701:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787862612 -> 1787862612 00002000:00010000:1.0:1787862612.490703:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787862612.490775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862612.490886:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 11 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.490896:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787862612.490901:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862612.490906:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.490933:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 11 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.490948:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 11 pid: 11687 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.490962:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653464b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526422400:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862612.491085:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6403015c00 going to sleep for 11 seconds 00000100:00080000:3.0:1787862612.491098:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862612.491109:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787862612.491116:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787862612.491158:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3283:x1874709526422144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 586us (740us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787862612.491166:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787862612.491213:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a653d5f9a40/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787862612.491236:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526422144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787862612.491250:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526422272 00000100:00100000:0.0:1787862612.491255:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526422272 00000100:00080000:1.0:1787862612.491283:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862612.491285:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787862612.491292:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526422272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787862612.491305:0:6672:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787862612.491328:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a909e53, atime: 0x6a909e53, ctime: 0x6a909e53, blocks: 0xb 00010000:00010000:0.0:1787862612.491334:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.491340:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1787862612.491343:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862612.491347:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.491358:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.491364:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.491370:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.491385:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862612.491516:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862612.491522:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.491530:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862612.491535:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.491544:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.491713:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.491722:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b13de37/0x9c5536ccf893053f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.491740:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862612.491742:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862612.491744:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862612.491869:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526422272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 577us (1092us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787862612.491886:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862612.491954:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787862612.491960:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1787862612.491978:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6511544780, transno 4294967301 00000004:00080000:1.0:1787862612.492038:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1787862612.492084:0:3282:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a65344cb480 x1874709526422272/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787862628 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787862612.492104:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a65344cb480/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787862612.492622:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526422272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787862612.495717:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862612.495889:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969856 00000100:00100000:0.0:1787862612.495898:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969856 00000100:00100000:0.0:1787862612.495980:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862612.495990:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+12:2349:x1874709516969856:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787862612.498513:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653464b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526422400:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862612.498546:0:11687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862612.498903:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862612.499343:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516969984 00000100:00100000:0.0:1787862612.499350:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516969984 00010000:00010000:0.0:1787862612.499393:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 13 pid: 11687 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.499430:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:0.0:1787862612.499440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+13:2348:x1874709516969984:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862612.499455:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862612.499461:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 13 pid: 11687 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.499475:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 13 pid: 11687 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.499500:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f42f658/0x9c5536ccf89302fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b347b3 expref: 13 pid: 11687 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.499517:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862612.499522:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862612.499528:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.499556:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.499584:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862612.499635:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+12:2348:x1874709516969984:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 196us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.499643:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00010000:00010000:2.0:1787862612.501565:0:11687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.501584:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.501596:0:11687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.501603:0:11687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.501641:0:11687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862612.504118:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862612.504131:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.504146:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862612.504151:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.504161:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.504182:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.504189:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009351983c/0x9c5536ccf8930538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.504209:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862612.504211:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862612.504213:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862612.504836:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3283:x1874709526422016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14356us (14488us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787862612.504849:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1787862612.508857:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6511542d00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787862612.508869:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511542d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526422016:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787862612.534606:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1787862612.534629:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787862612.535007:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516969856:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 39010us (39295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.535021:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:2.0:1787862612.538366:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.538437:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516970240 00000100:00100000:3.0:1787862612.538447:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516970240 00000100:00100000:3.0:1787862612.538552:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:3.0:1787862612.538565:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:10532:x1874709516970240:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862612.538634:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862612.538670:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44c00/0x9c5536ccf8930523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34846 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.538697:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:3.0:1787862612.538702:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862612.538734:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.538748:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.538758:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862612.539009:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f6a74e reply state 00000000bbfeb476 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.539018:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862612.539165:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:10532:x1874709516970240:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 602us (807us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787862612.539172:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:2.0:1787862612.543323:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.543530:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516970368 00000100:00100000:3.0:1787862612.543541:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516970368 00000100:00100000:3.0:1787862612.543607:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:3.0:1787862612.543619:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516970368:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787862612.543853:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787862612.543858:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787862612 -> 1787862611 00002000:00010000:3.0:1787862612.543860:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787862611 00002000:00010000:3.0:1787862612.543875:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787862612 -> 1787862611 00002000:00010000:3.0:1787862612.543877:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787862612.543947:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516970368:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 330us (632us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787862612.543956:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:2.0:1787862612.546695:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:0.0:1787862612.547257:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.547272:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.547280:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.547286:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862612.547291:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.547299:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.547316:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:0.0:1787862612.547320:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862612.547341:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.547348:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.547478:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516970624 00000100:00100000:1.0:1787862612.547489:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516970624 00000100:00100000:1.0:1787862612.547581:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 126 00000100:00100000:1.0:1787862612.547592:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+15:10532:x1874709516970624:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.547683:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.547696:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.547705:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.547741:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.547755:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 15 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.547768:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526422528:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862612.547847:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862612.551297:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862612.551366:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516970752 00000100:00100000:0.0:1787862612.551376:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516970752 00010000:00010000:0.0:1787862612.551419:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.551461:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1787862612.551471:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:2349:x1874709516970752:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862612.551486:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862612.551492:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.551507:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.551531:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:0.0:1787862612.551536:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.551546:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.551554:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.551572:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862612.551640:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:2349:x1874709516970752:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 170us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.551649:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00010000:00010000:1.0:1787862612.555861:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45800/0x9c5536ccf8930507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34838 expref: 15 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.555906:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874709526422528:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862612.555947:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.555956:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.555962:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.555993:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.556000:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.556006:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.556012:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.556016:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.556022:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.556037:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862612.556092:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787862612.556099:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.556111:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893054d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.556208:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+14:10532:x1874709516970624:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 Request processed in 8615us (9521us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787862612.556229:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 126 00000100:00100000:2.0:1787862612.562148:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.562276:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516970880 00000100:00100000:1.0:1787862612.562287:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516970880 00000100:00100000:1.0:1787862612.562351:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:1.0:1787862612.562362:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516970880:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.562412:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.562437:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.562447:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862612.562452:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862612.562457:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.562498:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.562515:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 7 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.562553:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526422656:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862612.562650:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193c00 going to sleep for 11 seconds 00010000:00010000:1.0:1787862612.572821:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862612.573385:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.573490:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526422656:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862612.573519:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.573596:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516971008 00000100:00100000:0.0:1787862612.573603:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516971008 00010000:00010000:0.0:1787862612.573641:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 8 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.573697:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:0.0:1787862612.573708:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516971008:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862612.573722:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862612.573745:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 8 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.573758:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 8 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.573782:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd412118/0x9c5536ccf8930531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34854 expref: 8 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.573800:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862612.573804:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862612.573810:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.573833:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.573883:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862612.574062:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574072:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574097:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574105:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574112:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574118:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862612.574122:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574137:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574150:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.574157:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c927a2c6/0x9c5536ccf8930554 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.574450:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516971008:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 741us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.574460:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:0.0:1787862612.578153:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516970880:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 15776us (15999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.578170:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:2.0:1787862612.583163:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.583263:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516971264 00000100:00100000:1.0:1787862612.583273:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516971264 00000100:00100000:1.0:1787862612.583372:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:1.0:1787862612.583391:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+14:10532:x1874709516971264:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862612.583468:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583485:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583498:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583788:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583800:0:7147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583890:0:7147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583982:0:7147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.583998:0:7147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 15 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.584012:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526422784:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862612.584152:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862612.589136:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.589271:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516971392 00000100:00100000:3.0:1787862612.589284:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516971392 00000100:00100000:1.0:1787862612.589406:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526422784:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862612.589436:0:7147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.589565:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862612.589700:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:2.0:1787862612.589711:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:2348:x1874709516971392:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862612.589725:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862612.589730:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.589739:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.589755:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44a00/0x9c5536ccf8930515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3483f expref: 16 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.589781:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:2.0:1787862612.589784:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.589790:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.589795:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.589822:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862612.589865:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:2348:x1874709516971392:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 155us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862612.589872:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00010000:00010000:1.0:1787862612.590107:0:7147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.590115:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862612.590315:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787862612.590462:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787862612.590508:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787862612.590591:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7147:1874709526422912:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787862612.590639:0:7147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862612.590669:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862612.591529:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526422912 00000100:00100000:3.0:1787862612.591537:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526422912 00000100:00100000:3.0:1787862612.591581:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862612.591589:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7147:x1874709526422912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787862612.591672:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7147:x1874709526422912:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.591680:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862612.591699:0:7147:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787862612.591704:0:7147:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787862612.591722:0:7147:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a653d5f9a40, transno 4294967309 00000100:00100000:1.0:1787862612.591750:0:7147:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6511542d00 x1874709526422016/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787862628 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862612.591761:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7147:1874709526422912:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787862612.592304:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787862612.592374:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7147:1874709526423040:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787862612.592413:0:7147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862612.592442:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862612.592621:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526423040 00000100:00100000:0.0:1787862612.592626:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526423040 00000100:00100000:0.0:1787862612.592651:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862612.592658:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7147:x1874709526423040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787862612.592847:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7147:x1874709526423040:12345-0@lo:1000:mdt00_003.0 Request processed in 189us (433us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787862612.592854:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862612.593313:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7147:1874709526423040:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787862612.593349:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593359:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593366:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593373:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.593377:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593384:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593401:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862612.593404:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862612.593418:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593424:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930562 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593456:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593462:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593467:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593472:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.593475:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593480:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593488:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862612.593491:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862612.593498:0:7147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593511:0:7147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593519:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.593562:0:7147:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.593575:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526423168:192.168.202.60@tcp:105: 00000100:00100000:1.0:1787862612.593645:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862612.599528:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.599856:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516971520 00000100:00100000:3.0:1787862612.599866:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516971520 00000100:00100000:3.0:1787862612.599932:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:3.0:1787862612.599943:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:10531:x1874709516971520:12345-192.168.202.60@tcp:49:lfs.0 00000100:00100000:3.0:1787862612.600114:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:10531:x1874709516971520:12345-192.168.202.60@tcp:49:lfs.0 Request processed in 172us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.600121:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:1.0:1787862612.600978:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526423168:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787862612.601014:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601025:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af45200/0x9c5536ccf89304a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601084:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601099:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601110:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601119:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601126:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601134:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601157:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.601161:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601168:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601181:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862612.601184:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862612.601188:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601193:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf8930569 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601203:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601208:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601213:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601230:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.601232:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601238:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601255:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862612.601257:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787862612.601260:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.601266:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf893055b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862612.601548:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+18:10532:x1874709516971264:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 18165us (18507us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787862612.601559:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00000020:00080000:1.0:1787862612.601564:0:7147:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787862612.604865:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.605094:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516971776 00000100:00100000:3.0:1787862612.605105:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516971776 00000100:00100000:3.0:1787862612.605160:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 128 00000100:00100000:3.0:1787862612.605171:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401993c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+18:10531:x1874709516971776:12345-192.168.202.60@tcp:58:lfs.0 00000040:00080000:3.0:1787862612.605580:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787862612.605668:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401993c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+18:10531:x1874709516971776:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 499us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.605676:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 128 00000040:00080000:2.0:1787862612.608528:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862612.608540:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862612.608577:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787862612.608584:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862612.608728:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526423296:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787862612.608836:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6403015c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862612.611008:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.611202:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516972032 00000100:00100000:3.0:1787862612.611214:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516972032 00000100:00100000:3.0:1787862612.611283:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:3.0:1787862612.611293:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:10532:x1874709516972032:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787862612.612134:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787862612.612251:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787862612.612299:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.612316:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.612327:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.612335:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.612341:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.612346:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.612367:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787862612.612476:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:10532:x1874709516972032:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 1183us (1477us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787862612.612493:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000020:00080000:3.0:1787862612.612499:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787862612.612619:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862612.612628:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.612636:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862612.612640:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.612648:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.612661:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6517c53e00) 00010000:00010000:1.0:1787862612.612664:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862612.612669:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.612675:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930570 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.612703:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862612.612705:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862612.612707:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862612.619441:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526423296:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862612.633576:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.633870:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516972160 00000100:00100000:3.0:1787862612.633881:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516972160 00000100:00100000:3.0:1787862612.634011:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:3.0:1787862612.634023:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+20:10534:x1874709516972160:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787862612.634122:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787862612.634243:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+20:10534:x1874709516972160:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 222us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862612.634251:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:0.0:1787862612.640871:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526423424:0@lo:400:kworker.0 00000100:00100000:0.0:1787862612.640983:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862612.641069:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862612.641077:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526423808:0@lo:400:kworker.0 00000100:00100000:0.0:1787862612.641109:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862612.643262:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526423424 00000100:00100000:2.0:1787862612.643277:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526423424 00000100:00100000:2.0:1787862612.643346:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787862612.643357:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526423424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862612.643448:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526423424:12345-0@lo:400:kworker.0 Request processed in 94us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862612.643472:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787862612.647160:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526423680:0@lo:400:kworker.0 00000100:00100000:2.0:1787862612.647263:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526423552:0@lo:400:kworker.0 00000100:00100000:0.0:1787862612.647515:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526423424:0@lo:400:kworker.0 00000100:00100000:0.0:1787862612.647568:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862612.651800:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526423808 00000100:00100000:1.0:1787862612.651924:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526423808 00000100:00100000:0.0:1787862612.658686:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526423552 00000100:00100000:0.0:1787862612.658704:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526423552 00000100:00100000:0.0:1787862612.658754:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787862612.658765:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526423552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862612.658909:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.658976:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862612.660545:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516972416 00000100:00100000:2.0:1787862612.660559:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516972416 00000100:00100000:2.0:1787862612.660609:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526423680 00000100:00100000:2.0:1787862612.660613:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526423680 00000100:00100000:2.0:1787862612.660650:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787862612.661980:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526423680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862612.662289:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862612.663197:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526423552:12345-0@lo:400:kworker.0 Request processed in 4429us (15624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.663209:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787862612.663254:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516972544 00000100:00100000:0.0:1787862612.663261:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516972544 00000100:00100000:0.0:1787862612.663293:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 130 00000100:00100000:0.0:1787862612.663300:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+21:10534:x1874709516972416:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862612.663316:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862612.663338:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930577 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3485b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.663438:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893057e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.663453:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893057e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.663466:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893057e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862612.663476:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787862612.663611:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930577 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3485b expref: 24 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.663649:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893057e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3485b expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.663669:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00000100:00100000:3.0:1787862612.664102:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526423552:0@lo:400:kworker.0 00010000:00010000:0.0:1787862612.664242:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787862612.664248:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918e00, rc 0) 00000100:00100000:0.0:1787862612.664317:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+23:10534:x1874709516972416:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1015us (5409us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787862612.664325:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 130 00000100:00100000:0.0:1787862612.664347:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:0.0:1787862612.664356:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+22:10535:x1874709516972544:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862612.664367:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862612.664380:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893058c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34862 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.668449:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.668478:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.668491:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.668508:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.668533:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.668540:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787862612.668809:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862612.669202:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.669229:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.669238:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.669274:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862612.669290:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 23 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.669305:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874709526423936:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862612.669395:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862612.669464:0:7147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787862612.669471:0:7147:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787862612.669612:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787862612.669625:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526423808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787862612.670563:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862612.671111:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862612.671336:0:5815:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787862612.671348:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516972800 00000100:00100000:1.0:1787862612.671357:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516972800 00000100:00100000:1.0:1787862612.671781:0:12007:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1787862612.671789:0:12007:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1787862612.672323:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:3.0:1787862612.672338:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+24:10534:x1874709516972800:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787862612.672422:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.672441:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.672454:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862612.673192:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526423808:12345-0@lo:400:kworker.0 Request processed in 3568us (32078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862612.673209:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00010000:3.0:1787862612.673297:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.673311:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.673319:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.673326:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862612.673331:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.673339:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.673353:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862612.673356:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862612.673360:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862612.673368:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.673516:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+25:10534:x1874709516972800:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 1183us (2408us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787862612.673524:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:1.0:1787862612.674025:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526423808:0@lo:400:kworker.0 00000040:00080000:0.0:1787862612.674211:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862612.674227:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787862612.674905:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526423680:12345-0@lo:400:kworker.0 Request processed in 14232us (15925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.675079:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526423680:0@lo:400:kworker.0 00000100:00100000:2.0:1787862612.675307:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:0.0:1787862612.676073:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787862612.676091:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862612.678840:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862612.679143:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516973056 00000100:00100000:3.0:1787862612.679154:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516973056 00000100:00100000:3.0:1787862612.679206:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862612.679229:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+25:10534:x1874709516973056:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787862612.679467:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+26:10534:x1874709516973056:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 251us (637us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787862612.679486:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:1.0:1787862612.679737:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874709526423936:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862612.679763:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862612.683998:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862612.684127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516973312 00000100:00100000:2.0:1787862612.684137:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516973312 00000100:00100000:2.0:1787862612.684200:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:2.0:1787862612.684212:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+26:5588:x1874709516973312:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787862612.684583:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+27:5588:x1874709516973312:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 372us (595us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787862612.684592:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:3.0:1787862612.687358:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862612.688318:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516973440 00000100:00100000:2.0:1787862612.688330:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516973440 00010000:00010000:2.0:1787862612.688387:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 27 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862612.688433:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:2.0:1787862612.688462:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+27:2349:x1874709516973440:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862612.688481:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862612.688489:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 27 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.688503:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 27 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.688527:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a650af44800/0x9c5536ccf8930497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3481c expref: 27 pid: 5815 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.688546:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862612.688551:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.688561:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.688568:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862612.688755:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862612.688835:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+26:2349:x1874709516973440:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 375us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862612.688843:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00010000:00010000:1.0:1787862612.690337:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690351:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862612.690403:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787862612.690409:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862612.690436:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690475:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690487:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690494:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690500:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690506:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.690511:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690519:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690532:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:1.0:1787862612.690535:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862612.690540:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690546:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919600/0x9c5536ccf8930593 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690561:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690567:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690582:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690587:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862612.690591:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690597:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690605:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6517dfcf00) 00010000:00010000:1.0:1787862612.690608:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862612.690611:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690617:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893059a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690667:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf893058c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34862 expref: 26 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690897:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34862 expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862612.690904:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862612.690906:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862612.690909:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919400, rc 0) 00000100:00100000:1.0:1787862612.691197:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+25:10535:x1874709516972544:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 26840us (28908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862612.691225:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:1.0:1787862613.149395:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526424064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862613.149479:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862613.149657:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424064 00000100:00100000:0.0:1787862613.149665:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424064 00000100:00100000:0.0:1787862613.149724:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862613.149734:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526424064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862613.149758:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787862613.151496:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526424064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1754us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862613.151508:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787862613.151730:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526424064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862613.596830:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862613.739685:0:12046:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862613.739696:0:12046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862613.739740:0:12046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787862613.739746:0:12046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862613.921827:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862613.921982:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516973696 00000100:00100000:3.0:1787862613.921992:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516973696 00000100:00100000:3.0:1787862613.922162:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:3.0:1787862613.922173:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+25:10558:x1874709516973696:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862613.922197:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862613.922337:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34869 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862613.922437:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89305b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862613.922454:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89305b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862613.922465:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89305b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862613.922477:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787862613.922599:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34869 expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862613.922621:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89305b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34869 expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862613.922654:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:3.0:1787862613.922657:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787862613.922661:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c400, rc 0) 00000100:00100000:3.0:1787862613.923033:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+27:10558:x1874709516973696:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 860us (1211us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787862613.923057:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:2.0:1787862613.928175:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862613.928261:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516973824 00000100:00100000:1.0:1787862613.928272:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516973824 00000100:00100000:1.0:1787862613.928337:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 134 00000100:00100000:1.0:1787862613.928348:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+27:10558:x1874709516973824:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:1.0:1787862613.928414:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928428:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928436:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928458:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928463:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928468:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928471:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862613.928474:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928487:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928495:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:1.0:1787862613.928497:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862613.928501:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862613.928505:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862613.928563:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+27:10558:x1874709516973824:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 218us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862613.928572:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 134 00000100:00100000:3.0:1787862613.993965:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862613.994135:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516973952 00000100:00100000:0.0:1787862613.994144:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516973952 00000100:00100000:0.0:1787862613.994199:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1787862613.994220:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534649680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516973952:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:0.0:1787862613.994244:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862613.994270:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30323b7/0x9c5536ccf89305cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34870 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862613.994302:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a909e53, atime: 0x6a909e53, ctime: 0x6a909e53, blocks: 0xb 00010000:00010000:0.0:1787862613.994323:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787862613.994327:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862613.994337:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30323b7/0x9c5536ccf89305cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34870 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862613.994372:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c30323b7/0x9c5536ccf89305cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34870 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862613.994387:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919600, rc 0) 00000100:00100000:0.0:1787862613.994470:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534649680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:2346:x1874709516973952:12345-192.168.202.60@tcp:101:cat.0 Request processed in 252us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862613.994475:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1787862613.998714:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862613.998873:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974080 00000100:00100000:3.0:1787862613.999279:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974080 00002000:00100000:3.0:1787862613.999336:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a653d9bcb40 x1874709516974080/t0(0) o3->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:729/0 lens 488/0 e 0 to 0 dl 1787862624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862613.999348:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a653d9bcb40 with x1874709516974080 ext(0->4095) 00002000:00010000:3.0:1787862613.999352:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a653d9bcb40 00000100:00100000:2.0:1787862613.999517:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1787862613.999528:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709516974080:12345-192.168.202.60@tcp:3:cat.0 00000100:00100000:2.0:1787862613.999855:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709516974080:12345-192.168.202.60@tcp:3:cat.0 Request processed in 329us (1150us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787862613.999865:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00002000:00100000:2.0:1787862613.999871:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a653d9bcb40 x1874709516974080/t0(0) o3->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:729/0 lens 488/4536 e 0 to 0 dl 1787862624 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862613.999877:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a653d9bcb40 with x1874709516974080 ext(0->4095) 00002000:00010000:2.0:1787862613.999880:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a653d9bcb40 00010000:00010000:3.0:1787862614.621483:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862614.684478:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526424192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862614.684574:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862614.684801:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424192 00000100:00100000:2.0:1787862614.684810:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424192 00000100:00100000:2.0:1787862614.684895:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862614.684906:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874709526424192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862614.684946:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862614.684997:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874709526424192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862614.685004:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787862614.685165:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862614.686774:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526424192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862615.647704:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862616.669404:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862617.304199:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862617.304255:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862617.304294:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862617.309334:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974208 00000100:00100000:0.0:1787862617.309357:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974208 00000100:00100000:3.0:1787862617.309668:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862617.309710:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862617.313850:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 300 00000100:00100000:0.0:1787862617.313899:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516974208:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862617.314021:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516974208:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 154us (9848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862617.314029:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 300 00000100:00100000:0.0:1787862617.315592:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974720 00000100:00100000:0.0:1787862617.315623:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974720 00000100:00100000:0.0:1787862617.315716:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974336 00000100:00100000:0.0:1787862617.315721:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974336 00000100:00100000:0.0:1787862617.315758:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 160 00000100:00100000:0.0:1787862617.315771:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516974720:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862617.315923:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709516974720:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 155us (11627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862617.315932:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 160 00000100:00100000:0.0:1787862617.315952:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 161 00000100:00100000:0.0:1787862617.315960:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+27:2347:x1874709516974336:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862617.315989:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+27:2347:x1874709516974336:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (6330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862617.315995:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 161 00000100:00080000:3.0:1787862617.320558:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862617.321013:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974464 00000100:00100000:1.0:1787862617.321032:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974464 00000100:00100000:1.0:1787862617.321138:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974592 00000100:00100000:1.0:1787862617.321142:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974592 00000100:00100000:1.0:1787862617.321194:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:1.0:1787862617.321211:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709516974464:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862617.321342:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709516974464:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 136us (17085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862617.321351:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:1.0:1787862617.321373:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:1.0:1787862617.321380:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516974592:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862617.321431:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516974592:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 51us (11720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862617.321437:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00080000:3.0:1787862617.321827:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862617.321833:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787862617.344026:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1787862617.692268:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862617.768202:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526424448:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.768317:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862617.768431:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424448 00000100:00100000:3.0:1787862617.768441:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424448 00000100:00100000:3.0:1787862617.768503:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787862617.768514:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526424448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.768582:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526424448:12345-0@lo:400:kworker.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862617.768590:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787862617.768892:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526424320:0@lo:400:kworker.0 00000100:00100000:2.0:1787862617.768951:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862617.769002:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424320 00000100:00100000:2.0:1787862617.769006:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424320 00000100:00100000:2.0:1787862617.769059:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787862617.769067:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526424320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862617.769106:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526424320:12345-0@lo:400:kworker.0 Request processed in 40us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862617.769113:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787862617.769182:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526424320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.770845:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526424448:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.770941:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526424576:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771010:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862617.771087:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862617.771096:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526424704:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771129:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862617.771175:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424704 00000100:00100000:3.0:1787862617.771184:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424704 00000100:00100000:3.0:1787862617.771262:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787862617.771271:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1874709526424704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771330:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1874709526424704:12345-0@lo:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862617.771338:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787862617.771359:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862617.771408:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526424704:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771437:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526424832:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771460:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862617.771484:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424576 00000100:00100000:3.0:1787862617.771487:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424576 00000100:00100000:3.0:1787862617.771525:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424832 00000100:00100000:3.0:1787862617.771528:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424832 00000100:00100000:3.0:1787862617.771546:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787862617.771552:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526424576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771584:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526424576:12345-0@lo:400:kworker.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862617.771589:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787862617.771599:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787862617.771604:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526424832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.771626:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526424832:12345-0@lo:400:kworker.0 Request processed in 23us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862617.771632:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1787862617.771644:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862617.771666:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526424576:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.776549:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526424832:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.778473:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862617.778511:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526424960:0@lo:400:kworker.0 00000100:00100000:3.0:1787862617.778629:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862617.784504:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526424960 00000100:00100000:2.0:1787862617.784529:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526424960 00000100:00100000:2.0:1787862617.784761:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862617.784777:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862617.784917:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526424960:12345-0@lo:400:kworker.0 Request processed in 144us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862617.784928:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787862617.786270:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862617.786357:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787862617.786368:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a65344cb480, transno 4294967304 00000100:00100000:3.0:1787862617.786398:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526424960:0@lo:400:kworker.0 00000001:00080000:1.0:1787862617.858751:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:1.0:1787862617.858793:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a651039c540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787862617.858800:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a650ad49200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a651039c6c0 00000020:00080000:1.0:1787862617.858804:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a650ad49500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a650537f400 00000001:00080000:1.0:1787862617.858839:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:1.0:1787862617.858849:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787862617.858874:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787862617.859612:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787862617.859861:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787862617.880038:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787862617.880094:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1787862618.268373:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862618.268408:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526425088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862618.268518:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862618.268646:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425088 00000100:00100000:2.0:1787862618.268656:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425088 00000100:00100000:2.0:1787862618.268729:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787862618.268742:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526425088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862618.268794:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862618.268854:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526425088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862618.268862:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787862618.268958:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526425088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862618.717122:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862618.844992:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862618.845007:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862618.847098:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787862618.847118:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787862619.741555:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862619.804976:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862619.805010:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526425216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862619.805162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862619.805274:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425216 00000100:00100000:3.0:1787862619.805284:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425216 00000100:00100000:3.0:1787862619.805350:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787862619.805364:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526425216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862619.805415:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862619.805469:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526425216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862619.805477:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787862619.805501:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862619.805555:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787862619.805561:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6511542d00, transno 4294967310 00000004:00080000:3.0:1787862619.805572:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787862619.805621:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526425216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862620.452302:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862620.452527:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516974848 00000100:00100000:2.0:1787862620.452541:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516974848 00000100:00100000:2.0:1787862620.452652:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:2.0:1787862620.452669:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511542d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+14:10220:x1874709516974848:12345-192.168.202.60@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787862620.452841:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511542d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+14:10220:x1874709516974848:12345-192.168.202.60@tcp:60:lhsmtool_posix.0 Request processed in 177us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862620.452870:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00080000:3.0:1787862620.453477:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862620.462347:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862620.462472:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975104 00000100:00100000:2.0:1787862620.462490:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975104 00000100:00100000:2.0:1787862620.462747:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:2.0:1787862620.462762:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+14:10220:x1874709516975104:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787862620.467282:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+15:10220:x1874709516975104:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 4514us (4934us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787862620.467297:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00010000:00010000:1.0:1787862620.772745:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862621.036224:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862621.036489:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975232 00000100:00100000:3.0:1787862621.036508:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975232 00000100:00100000:3.0:1787862621.036725:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 136 00000100:00100000:3.0:1787862621.036740:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+5:11013:x1874709516975232:12345-192.168.202.60@tcp:101:lsof.0 00010000:00010000:3.0:1787862621.036762:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862621.036796:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34877 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862621.036989:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862621.037019:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862621.037033:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862621.037310:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862621.037315:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862621.037418:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862621.037448:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89305d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862621.037468:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862621.037476:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:3.0:1787862621.037479:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862621.037483:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c200, rc 0) 00000100:00100000:3.0:1787862621.038015:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:09001ba1-03f5-4db1-a589-c226f7e46380+6:11013:x1874709516975232:12345-192.168.202.60@tcp:101:lsof.0 Request processed in 1278us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862621.038026:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 136 00000100:00080000:0.0:1787862621.038982:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787862621.788614:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862622.413203:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862622.413251:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862622.413282:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862622.413309:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862622.413321:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975616 00000100:00100000:2.0:1787862622.413338:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975616 00000100:00100000:3.0:1787862622.413366:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975360 00000100:00100000:3.0:1787862622.413371:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975360 00000100:00100000:3.0:1787862622.413419:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 302 00000100:00100000:2.0:1787862622.413419:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:3.0:1787862622.413432:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516975360:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862622.413441:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516975616:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862622.413651:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709516975360:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 220us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862622.413652:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516975616:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 219us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862622.413661:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:3.0:1787862622.413677:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 302 00000100:00100000:0.0:1787862622.413769:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862622.413834:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975744 00000100:00100000:3.0:1787862622.413840:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975744 00000100:00100000:3.0:1787862622.413881:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:3.0:1787862622.413891:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516975744:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862622.413963:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516975744:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862622.414019:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:0.0:1787862622.416269:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975872 00000100:00100000:0.0:1787862622.416284:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975872 00000100:00100000:0.0:1787862622.416351:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516975488 00000100:00100000:0.0:1787862622.416355:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516975488 00000100:00100000:0.0:1787862622.416471:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00100000:0.0:1787862622.416485:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+6:2346:x1874709516975872:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862622.416492:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 166 00000100:00100000:2.0:1787862622.416507:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+15:2346:x1874709516975488:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862622.416653:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+6:2346:x1874709516975872:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 171us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862622.416661:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00080000:0.0:1787862622.416686:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862622.416692:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862622.416701:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+15:2346:x1874709516975488:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 198us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862622.416711:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 166 00000100:00080000:0.0:1787862622.416714:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862622.813866:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862622.889618:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526425472:0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.889697:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862622.889763:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526425984:0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.889791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862622.889831:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862622.889837:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526425600:0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.889877:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862622.889917:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425472 00000100:00100000:1.0:1787862622.889926:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425472 00000100:00100000:1.0:1787862622.889968:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425600 00000100:00100000:1.0:1787862622.889971:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425600 00000100:00100000:1.0:1787862622.890004:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787862622.890015:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526425472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.890096:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526425472:12345-0@lo:400:kworker.0 Request processed in 81us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862622.890105:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787862622.890134:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787862622.890141:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526425600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.890169:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526425600:12345-0@lo:400:kworker.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862622.890175:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787862622.890223:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526425600:0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.890243:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526425472:0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.890290:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425984 00000100:00100000:1.0:1787862622.890294:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425984 00000100:00100000:1.0:1787862622.890328:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787862622.890337:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526425984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.890370:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526425984:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862622.890375:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787862622.890395:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526425984:0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.890491:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526425728:0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.890519:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862622.890551:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787862622.890556:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526425344:0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.890579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862622.890596:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526425856:0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.890613:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862622.890634:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425344 00000100:00100000:0.0:1787862622.890637:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425344 00000100:00100000:0.0:1787862622.890657:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787862622.890663:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526425344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.890690:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526425344:12345-0@lo:400:kworker.0 Request processed in 28us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862622.890695:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:0.0:1787862622.891182:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862622.891188:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862622.891211:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526425344:0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.891232:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425856 00000100:00100000:0.0:1787862622.891235:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425856 00000100:00100000:0.0:1787862622.891264:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787862622.891270:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526425856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862622.891302:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526425856:12345-0@lo:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862622.891308:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1787862622.891319:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862622.891331:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526425856:0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.892184:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526425728 00000100:00100000:1.0:1787862622.892192:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526425728 00000100:00100000:1.0:1787862622.892244:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787862622.892254:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511602940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526425728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862622.892303:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511602940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526425728:12345-0@lo:400:kworker.0 Request processed in 50us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862622.892309:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787862622.892334:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526425728:0@lo:400:kworker.0 00000100:00080000:0.0:1787862622.892849:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1787862622.979612:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1787862622.979646:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787862622.979917:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787862622.979929:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787862623.388420:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862623.388448:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534640f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526426112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862623.388521:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862623.388937:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426112 00000100:00100000:2.0:1787862623.388945:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426112 00000100:00100000:2.0:1787862623.389003:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787862623.389013:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526426112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862623.389070:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862623.389128:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526426112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862623.389151:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862623.389247:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534640f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526426112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862623.836815:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862624.860293:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862624.929946:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862624.929978:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511603840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526426240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862624.930090:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862624.931848:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426240 00000100:00100000:3.0:1787862624.931874:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426240 00000100:00100000:3.0:1787862624.931966:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787862624.931977:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526426240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862624.932016:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862624.932142:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65116021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526426240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862624.932149:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787862624.932721:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862624.932778:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511603840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526426240:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787862625.417391:0:12248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:30:23 (1787862623) 00010000:00010000:2.0:1787862625.884220:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862626.811997:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862626.812080:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976128 00000100:00100000:1.0:1787862626.812108:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976128 00000100:00100000:1.0:1787862626.812255:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:1.0:1787862626.812268:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+14:11278:x1874709516976128:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862626.812291:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862626.812313:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3487e expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812412:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812426:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812440:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812453:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812459:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812465:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812878:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89305f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812888:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89305f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.812895:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89305f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862626.812905:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787862626.813149:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813167:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813174:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813180:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204ee00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862626.813184:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813191:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813205:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:1.0:1787862626.813208:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862626.813213:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813219:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89305e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813232:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813238:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813244:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813248:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862626.813258:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813269:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813276:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6516880c00) 00010000:00010000:1.0:1787862626.813278:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862626.813281:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.813286:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89305ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.815211:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89305e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3487e expref: 17 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.815239:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89305f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3487e expref: 16 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862626.815249:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:1.0:1787862626.815252:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862626.815255:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204fa00, rc 0) 00000100:00100000:1.0:1787862626.815400:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+16:11278:x1874709516976128:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 3134us (3409us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787862626.815410:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00080000:0.0:1787862626.815685:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862626.832238:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862626.832295:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862626.832394:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976256 00000100:00100000:2.0:1787862626.832404:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976256 00000100:00100000:2.0:1787862626.832481:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1787862626.832492:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+16:2349:x1874709516976256:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862626.832509:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862626.832536:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89305f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3487e expref: 16 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862626.832557:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:2.0:1787862626.832562:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862626.832621:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+15:2349:x1874709516976256:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862626.832628:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1787862626.832757:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976384 00000100:00100000:0.0:1787862626.832762:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976384 00000100:00100000:0.0:1787862626.832803:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:0.0:1787862626.832811:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:11278:x1874709516976384:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787862626.832873:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:11278:x1874709516976384:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 Request processed in 64us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862626.832878:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 138 00010000:00010000:3.0:1787862626.910518:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862627.036701:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862627.036724:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862627.037259:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787862627.037269:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862627.532140:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862627.532193:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862627.532230:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862627.532254:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862627.532280:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862627.533767:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976768 00000100:00100000:1.0:1787862627.533808:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976768 00000100:00100000:1.0:1787862627.533877:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976896 00000100:00100000:1.0:1787862627.533881:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976896 00000100:00100000:1.0:1787862627.533907:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:1.0:1787862627.533918:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511603840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516976768:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862627.533999:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511603840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+6:2347:x1874709516976768:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 83us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862627.534006:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:1.0:1787862627.534032:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:1.0:1787862627.534039:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516976896:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862627.534121:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709516976896:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 83us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862627.534128:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00080000:0.0:1787862627.534393:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862627.534403:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862627.535359:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976512 00000100:00100000:3.0:1787862627.535376:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976512 00000100:00100000:3.0:1787862627.535462:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 304 00000100:00100000:3.0:1787862627.535476:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516976512:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862627.535598:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65093f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709516976512:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 126us (3476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862627.535628:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 304 00000100:00100000:3.0:1787862627.535687:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516977024 00000100:00100000:3.0:1787862627.535692:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516977024 00000100:00100000:3.0:1787862627.535740:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516976640 00000100:00100000:3.0:1787862627.535744:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516976640 00000100:00100000:3.0:1787862627.535768:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 170 00000100:00100000:3.0:1787862627.535776:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+6:2347:x1874709516977024:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862627.535812:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09001ba1-03f5-4db1-a589-c226f7e46380+6:2347:x1874709516977024:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 37us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862627.535819:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 170 00000100:00100000:3.0:1787862627.535832:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00100000:3.0:1787862627.535839:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+15:2347:x1874709516976640:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862627.535865:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+15:2347:x1874709516976640:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862627.535871:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00080000:3.0:1787862627.535904:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862627.933283:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862628.004929:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526426496:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.004943:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526426752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862628.005086:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862628.005159:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526427008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862628.005193:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862628.005235:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862628.005241:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526426624:0@lo:400:kworker.0 00000100:00100000:1.0:1787862628.005269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862628.005316:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426496 00000100:00100000:1.0:1787862628.005325:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426496 00000100:00100000:1.0:1787862628.005386:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426624 00000100:00100000:1.0:1787862628.005392:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426624 00000100:00100000:3.0:1787862628.005394:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862628.005447:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787862628.005454:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787862628.005462:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526426496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.005468:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526426368:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.005509:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862628.005549:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526426880:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.005582:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862628.005690:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426880 00000100:00100000:2.0:1787862628.005696:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426880 00000100:00100000:2.0:1787862628.005738:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787862628.005747:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526426624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862628.005802:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526426624:12345-0@lo:400:kworker.0 Request processed in 57us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862628.005811:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787862628.005844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787862628.005850:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526426880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862628.005884:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526426880:12345-0@lo:400:kworker.0 Request processed in 34us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862628.005890:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787862628.006264:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526426496:12345-0@lo:400:kworker.0 Request processed in 805us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862628.006273:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787862628.006330:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526426624:0@lo:400:kworker.0 00000100:00100000:1.0:1787862628.006346:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526426496:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.007019:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526426880:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.007463:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526427008 00000100:00100000:3.0:1787862628.007470:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526427008 00000100:00100000:3.0:1787862628.007524:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426752 00000100:00100000:3.0:1787862628.007528:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426752 00000100:00100000:3.0:1787862628.007553:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787862628.007562:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526427008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.008161:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526427008:12345-0@lo:400:kworker.0 Request processed in 596us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862628.008170:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787862628.008190:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787862628.008202:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526426752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.008247:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526426752:12345-0@lo:400:kworker.0 Request processed in 50us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862628.008255:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1787862628.008287:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862628.008292:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862628.008295:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862628.008874:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526426368 00000100:00100000:3.0:1787862628.008882:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526426368 00000100:00100000:3.0:1787862628.008928:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787862628.008937:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526426368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.008986:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526426368:12345-0@lo:400:kworker.0 Request processed in 52us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862628.008994:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787862628.010778:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526427008:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.012941:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526426368:0@lo:400:kworker.0 00000100:00100000:3.0:1787862628.012968:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526426752:0@lo:400:kworker.0 00000040:00080000:3.0:1787862628.062437:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862628.062449:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862628.063565:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787862628.063577:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787862628.098149:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:3.0:1787862628.510226:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862628.510255:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526427136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862628.510920:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862628.511148:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526427136 00000100:00100000:2.0:1787862628.511160:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526427136 00000100:00100000:2.0:1787862628.511212:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787862628.511222:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526427136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862628.511262:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862628.511431:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526427136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862628.511441:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862628.511551:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526427136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862628.957756:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862629.563744:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862629.563846:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516977152 00000100:00100000:2.0:1787862629.563856:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516977152 00000100:00100000:2.0:1787862629.563940:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 139 00000100:00100000:2.0:1787862629.563951:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+14:11321:x1874709516977152:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862629.563969:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862629.563991:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34885 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564096:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564112:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564132:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564145:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564149:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564152:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564369:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564377:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564383:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564389:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862629.564393:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564401:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564414:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:2.0:1787862629.564418:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862629.564423:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564433:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893060a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564448:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564452:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564455:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564458:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862629.564460:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564463:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564467:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862629.564469:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862629.564470:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564473:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930611 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564501:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930603 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34885 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564521:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:2.0:1787862629.564523:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862629.564527:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34885 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.564538:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:2.0:1787862629.564600:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+14:11321:x1874709516977152:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 652us (866us total) trans 0 rc 301/301 00000100:00100000:2.0:1787862629.564605:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 139 00000100:00080000:3.0:1787862629.565090:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862629.568478:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.568545:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516977408 00000100:00100000:0.0:1787862629.568554:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516977408 00000100:00100000:0.0:1787862629.568600:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 140 00000100:00100000:0.0:1787862629.568607:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+14:11321:x1874709516977408:12345-192.168.202.60@tcp:36:lfs.0 00010000:00010000:0.0:1787862629.568651:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862629.568674:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf892ff81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346be expref: 14 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.568691:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:0.0:1787862629.568696:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862629.568972:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.568986:0:7147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.568993:0:7147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.569036:0:7147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.569085:0:7147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 5 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.569098:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526427264:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862629.569186:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862629.571137:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526427264:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862629.571165:0:7147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862629.574136:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.574268:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516977536 00000100:00100000:0.0:1787862629.574277:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516977536 00010000:00010000:0.0:1787862629.574319:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 6 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.574346:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:0.0:1787862629.574353:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09001ba1-03f5-4db1-a589-c226f7e46380+6:2348:x1874709516977536:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862629.574369:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862629.574376:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 6 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574389:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 6 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574410:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89305d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34877 expref: 6 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574424:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:0.0:1787862629.574428:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574435:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574441:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574470:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862629.574522:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516977536:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 170us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862629.574528:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00010000:00010000:0.0:1787862629.574599:0:7147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574605:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574621:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574628:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.574633:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862629.575627:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787862629.575643:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.575650:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.575655:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.575659:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862629.575663:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.575691:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.575703:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6516880100) 00010000:00010000:0.0:1787862629.575706:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862629.575710:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.575717:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930618 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862629.575735:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e00107c reply state 00000000e74b0033 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.575743:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862629.575820:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+15:11321:x1874709516977408:12345-192.168.202.60@tcp:36:lfs.0 Request processed in 7211us (7348us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787862629.575825:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 140 00000100:00080000:3.0:1787862629.576719:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862629.579885:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.580034:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.580142:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.580148:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862629.580152:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.580173:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.580190:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6517dfc500) 00010000:00010000:0.0:1787862629.580193:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862629.580198:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.580205:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893061f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.664038:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862629.664258:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516977664 00000100:00100000:3.0:1787862629.664271:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516977664 00000100:00100000:3.0:1787862629.664332:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:3.0:1787862629.664343:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+14:11329:x1874709516977664:12345-192.168.202.60@tcp:101:lctl.0 00010000:00010000:3.0:1787862629.664499:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862629.664528:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3488c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.664605:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf893062d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.664621:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf893062d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.664634:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf893062d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862629.664761:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787862629.664771:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862629.664805:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf893062d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.664833:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3488c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.664914:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf893062d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3488c expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.664924:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:3.0:1787862629.664927:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862629.664931:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d600, rc 0) 00000100:00100000:3.0:1787862629.664996:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+15:11329:x1874709516977664:12345-192.168.202.60@tcp:101:lctl.0 Request processed in 655us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862629.665003:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:3.0:1787862629.730617:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862629.730689:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516977792 00000100:00100000:2.0:1787862629.730699:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516977792 00000100:00100000:2.0:1787862629.730800:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 142 00000100:00100000:2.0:1787862629.730809:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+15:11335:x1874709516977792:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862629.730827:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862629.730844:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34893 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.730903:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.730918:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.730926:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.730937:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.730947:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.730951:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731035:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731083:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731092:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862629.731121:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787862629.731124:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862629.731139:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731148:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731152:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731157:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731161:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862629.731164:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731174:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731183:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:2.0:1787862629.731185:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862629.731188:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731192:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf893063b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731207:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731210:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731214:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731217:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862629.731218:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731222:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731225:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862629.731226:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862629.731228:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731237:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930642 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731261:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34893 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731269:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34893 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.731273:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862629.731275:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862629.731277:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:2.0:1787862629.731329:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+16:11335:x1874709516977792:12345-192.168.202.60@tcp:101:bash.0 Request processed in 521us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862629.731336:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 142 00000100:00100000:2.0:1787862629.733914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862629.733956:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516978048 00000100:00100000:3.0:1787862629.733965:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516978048 00000100:00100000:3.0:1787862629.734017:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00100000:3.0:1787862629.734027:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+16:11335:x1874709516978048:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862629.734112:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862629.734132:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3489a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.734240:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.734251:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.734272:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.734319:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.734324:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.734329:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862629.734966:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787862629.735156:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735164:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735170:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735193:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735198:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735202:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735206:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862629.735214:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735219:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735227:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:3.0:1787862629.735229:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862629.735232:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735237:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930657 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862629.735245:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e5427ae reply state 00000000f31c26fc transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862629.735251:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787862629.735273:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735281:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.735286:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862629.735288:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862629.735289:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422de00, rc 0) 00000100:00100000:3.0:1787862629.735347:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11335:x1874709516978048:12345-192.168.202.60@tcp:101:bash.0 Request processed in 1322us (1441us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787862629.735365:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 143 00010000:00010000:0.0:1787862629.736647:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.736661:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.736668:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.736674:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862629.736678:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.736684:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.736699:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517c53000) 00010000:00010000:0.0:1787862629.736703:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862629.736716:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.736722:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893065e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862629.738277:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862629.738373:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516978176 00000100:00100000:1.0:1787862629.738385:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516978176 00000100:00100000:1.0:1787862629.738456:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:1.0:1787862629.738464:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709516978176:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862629.738482:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862629.738499:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348a1 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862629.738520:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862629.738537:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1787862629.738540:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862629.738548:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.738561:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.738571:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ee00, rc 0) 00000100:00100000:1.0:1787862629.738622:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709516978176:12345-192.168.202.60@tcp:101:bash.0 Request processed in 158us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862629.738641:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00080000:3.0:1787862629.738733:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862629.740835:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862629.740996:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516978304 00000100:00100000:1.0:1787862629.741004:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516978304 00000100:00100000:1.0:1787862629.741115:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:1.0:1787862629.741123:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+6:11335:x1874709516978304:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862629.741139:0:12006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862629.741155:0:12006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348a8 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.741188:0:12006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.741194:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862629.741197:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862629.741201:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 7 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.741232:0:12006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.741243:0:12006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862629.741253:0:12006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12006:1874709526427392:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862629.741333:0:12006:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650514a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862629.743017:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862629.743090:0:12006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12006:1874709526427392:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862629.743122:0:12006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 7 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.743137:0:12006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f400, rc 0) 00000100:00100000:1.0:1787862629.743177:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:11335:x1874709516978304:12345-192.168.202.60@tcp:101:bash.0 Request processed in 2055us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862629.743184:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:2.0:1787862629.743252:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516978432 00000100:00100000:2.0:1787862629.743257:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516978432 00010000:00010000:2.0:1787862629.743283:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862629.743306:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:2.0:1787862629.743312:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516978432:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862629.743321:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862629.743338:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.743358:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.743380:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c927a2c6/0x9c5536ccf8930673 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a1 expref: 7 pid: 6671 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.743393:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862629.743397:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862629.743405:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 6 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.743416:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 6 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.743442:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 6 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862629.743452:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346421c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5800:1874709526427520:192.168.202.60@tcp:105: 00000100:00100000:2.0:1787862629.743487:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6534785540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862629.745768:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346421c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5800:1874709526427520:192.168.202.60@tcp:105: 00010000:00010000:3.0:1787862629.745794:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862629.745850:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2349:x1874709516978432:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 2536us (2840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862629.745859:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:3.0:1787862629.748300:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.748564:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516978688 00000100:00100000:0.0:1787862629.748574:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516978688 00000100:00100000:0.0:1787862629.748632:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:0.0:1787862629.748644:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+18:11335:x1874709516978688:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:0.0:1787862629.749000:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11335:x1874709516978688:12345-192.168.202.60@tcp:35:bash.0 Request processed in 359us (708us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787862629.749006:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:1.0:1787862629.804211:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.804260:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516978944 00000100:00100000:0.0:1787862629.804270:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516978944 00000100:00100000:0.0:1787862629.804360:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 144 00000100:00100000:0.0:1787862629.804370:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+19:11345:x1874709516978944:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862629.804395:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862629.804416:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348af expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862629.804523:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787862629.804624:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930681 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348af expref: 21 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.804635:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:0.0:1787862629.804637:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862629.804651:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348af expref: 21 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.804661:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918600, rc 0) 00000100:00100000:0.0:1787862629.804727:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+20:11345:x1874709516978944:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 358us (526us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787862629.804735:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 144 00000100:00100000:3.0:1787862629.806791:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.806866:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516979200 00000100:00100000:0.0:1787862629.806874:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516979200 00000100:00100000:0.0:1787862629.806956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:0.0:1787862629.806963:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:11345:x1874709516979200:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862629.807221:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:11345:x1874709516979200:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 258us (436us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787862629.807227:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:1.0:1787862629.888282:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.888658:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516979328 00000100:00100000:0.0:1787862629.888669:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516979328 00000100:00100000:0.0:1787862629.888928:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 145 00000100:00100000:0.0:1787862629.888939:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+21:11351:x1874709516979328:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862629.888968:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862629.888990:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893068f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348b6 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.889228:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.889244:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.889277:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862629.889342:0:12007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787862629.889346:0:12007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862629.889369:0:12007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.889396:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893068f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348b6 expref: 23 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.889427:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348b6 expref: 22 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.889436:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862629.889439:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862629.889443:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00100000:0.0:1787862629.889522:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+22:11351:x1874709516979328:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 585us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862629.889530:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 145 00000100:00100000:1.0:1787862629.895550:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.895604:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516979584 00000100:00100000:0.0:1787862629.895614:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516979584 00000100:00100000:0.0:1787862629.895680:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 146 00000100:00100000:0.0:1787862629.895691:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+22:11351:x1874709516979584:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862629.895711:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862629.895731:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893069d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348bd expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.895857:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.895872:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.895885:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862629.895894:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787862629.896021:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf893069d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348bd expref: 25 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.896098:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348bd expref: 24 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.896108:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:0.0:1787862629.896111:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862629.896115:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918000, rc 0) 00000100:00100000:0.0:1787862629.896183:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+24:11351:x1874709516979584:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 494us (640us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787862629.896191:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 146 00000100:00100000:3.0:1787862629.902009:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862629.902161:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862629.902313:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516979968 00000100:00100000:1.0:1787862629.902323:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516979968 00000100:00100000:1.0:1787862629.902384:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:1.0:1787862629.902394:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+24:11351:x1874709516979968:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862629.902427:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862629.902451:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89306b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348c4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.902549:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89306b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.902563:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89306b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.902574:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89306b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862629.902587:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787862629.902738:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89306b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348c4 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.902756:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89306b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348c4 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.902764:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:1.0:1787862629.902767:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862629.902770:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204f600, rc 0) 00000100:00100000:1.0:1787862629.902833:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+26:11351:x1874709516979968:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 441us (672us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787862629.902841:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:0.0:1787862629.903556:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516979712 00000100:00100000:0.0:1787862629.903564:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516979712 00000100:00100000:0.0:1787862629.903613:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:0.0:1787862629.903622:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+26:2349:x1874709516979712:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862629.903633:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862629.903659:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348bd expref: 26 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.903672:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:0.0:1787862629.903677:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862629.903747:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+25:2349:x1874709516979712:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 127us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862629.903766:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1787862629.911528:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862629.911706:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516980096 00000100:00100000:1.0:1787862629.911717:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516980096 00000100:00100000:1.0:1787862629.911916:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:1.0:1787862629.911928:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516980096:12345-192.168.202.60@tcp:1:lfs.0 00010000:00010000:1.0:1787862629.911971:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.911990:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 6 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.911999:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862629.912003:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862629.912008:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.912208:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 6 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862629.912238:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 6 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862629.912253:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11687:1874709526427648:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862629.912341:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862629.919840:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862629.920197:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11687:1874709526427648:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862629.920237:0:11687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862629.920901:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516980224 00000100:00100000:2.0:1787862629.920910:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516980224 00002000:00100000:2.0:1787862629.920963:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a640319b480 x1874709516980224/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:745/0 lens 504/0 e 0 to 0 dl 1787862640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862629.920974:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a640319b480 with x1874709516980224 ext(0->12) 00010000:00010000:2.0:1787862629.920995:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 7 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.921011:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 7 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862629.921019:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a640319b480 00000100:00100000:2.0:1787862629.921222:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:2.0:1787862629.921236:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516980224:12345-192.168.202.60@tcp:4:lfs.0 00000100:00100000:2.0:1787862629.921817:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516980224:12345-192.168.202.60@tcp:4:lfs.0 Request processed in 583us (1986us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787862629.925033:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00002000:00100000:2.0:1787862629.925076:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a640319b480 x1874709516980224/t4294967305(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:745/0 lens 504/448 e 0 to 0 dl 1787862640 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862629.925087:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a640319b480 with x1874709516980224 ext(0->12) 00010000:00010000:2.0:1787862629.925098:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 9 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.925305:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 9 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862629.925314:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a640319b480 00000100:00100000:2.0:1787862629.926138:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.926276:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516980352 00000100:00100000:0.0:1787862629.926285:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516980352 00010000:00010000:0.0:1787862629.926318:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 9 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.926356:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:0.0:1787862629.926366:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516980352:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862629.926379:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787862629.926397:0:5801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787862629.926400:0:5801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787862629 00002000:00010000:0.0:1787862629.926402:0:5801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787862629 00002000:00010000:0.0:1787862629.926405:0:5801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787862629 00010000:00010000:0.0:1787862629.926411:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 9 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.926424:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 9 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.926447:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf893067a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348a8 expref: 9 pid: 12006 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.926478:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862629.926483:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862629.926489:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.926511:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.926546:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862629.926596:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516980352:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 232us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862629.926604:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 64 00010000:00010000:2.0:1787862629.926766:0:11687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926788:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926813:0:11687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926821:0:11687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926829:0:11687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926835:0:11687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862629.926839:0:11687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926847:0:11687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926859:0:11687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.926866:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022786b21/0x9c5536ccf89306c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862629.926921:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516980096:12345-192.168.202.60@tcp:1:lfs.0 Request processed in 14996us (15404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862629.926930:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:3.0:1787862629.930129:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862629.930317:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516980608 00000100:00100000:0.0:1787862629.930330:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516980608 00000100:00100000:0.0:1787862629.930513:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:0.0:1787862629.930525:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+25:11351:x1874709516980608:12345-192.168.202.60@tcp:35:lfs.0 00000004:00010000:0.0:1787862629.930606:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89306b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348c4 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862629.930943:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787862629.930987:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787862629.933385:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787862629.933478:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.933513:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.933531:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.933573:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.933589:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 29 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.933605:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1874709526427776:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862629.934314:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862629.940141:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862629.940908:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516980736 00000100:00100000:2.0:1787862629.940920:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516980736 00010000:00010000:2.0:1787862629.940967:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 30 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862629.941021:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:2.0:1787862629.941033:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+30:2349:x1874709516980736:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862629.941083:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862629.941091:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 30 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.941234:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 30 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.941259:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:2.0:1787862629.941264:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.941273:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.941280:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.941316:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862629.941416:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+30:2349:x1874709516980736:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 385us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862629.941424:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00010000:00010000:0.0:1787862629.942094:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930665 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3489a expref: 29 pid: 5815 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862629.942255:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1874709526427776:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862629.942279:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.942288:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862629.942294:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862629.942431:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787862629.942878:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787862629.942998:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874709526427904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787862629.943378:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862629.943415:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787862629.943487:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526427904 00000100:00100000:2.0:1787862629.943504:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526427904 00000100:00100000:2.0:1787862629.943557:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787862629.943567:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874709526427904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787862629.943646:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874709526427904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862629.943654:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862629.943801:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874709526427904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787862629.944294:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787862629.944358:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874709526428032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787862629.944390:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862629.944404:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862629.945634:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526428032 00000100:00100000:2.0:1787862629.945646:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526428032 00000100:00100000:2.0:1787862629.945695:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787862629.945704:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874709526428032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787862629.945927:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1874709526428032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 224us (1536us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787862629.945935:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787862629.946033:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874709526428032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787862629.946155:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787862629.946203:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.946214:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.946222:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.946244:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862629.946249:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.946256:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.946273:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862629.946276:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787862629.946280:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862629.946287:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89306ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787862629.946468:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787862629.946589:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787862629.946600:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355710556996ns, next at 356710554854ns, rc = 0 00000001:00080000:3.0:1787862629.946606:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787862629.946639:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862629.946642:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787862629.946649:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89306b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348c4 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862629.946741:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+32:11351:x1874709516980608:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 16219us (16625us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787862629.946749:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000020:00080000:3.0:1787862629.946753:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787862629.950743:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862629.950884:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516980864 00000100:00100000:2.0:1787862629.950894:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516980864 00000100:00100000:2.0:1787862629.950961:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00100000:2.0:1787862629.950971:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+32:11351:x1874709516980864:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862629.951001:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862629.951025:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89306d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348cb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.951163:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89306d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348cb expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.951179:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89306d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348cb expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862629.951199:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862629.951202:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862629.951206:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc000, rc 0) 00000100:00100000:2.0:1787862629.951261:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+33:11351:x1874709516980864:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 291us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862629.951268:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00100000:2.0:1787862629.955584:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862629.956220:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516981120 00000100:00100000:3.0:1787862629.956230:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516981120 00000100:00100000:2.0:1787862629.956412:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:2.0:1787862629.956424:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+33:11351:x1874709516981120:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787862629.957128:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+34:11351:x1874709516981120:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 705us (1551us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787862629.957136:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00010000:00010000:2.0:1787862629.980180:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862630.053383:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862630.053408:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65099f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526428160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862630.053503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862630.053985:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526428160 00000100:00100000:3.0:1787862630.053995:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526428160 00000100:00100000:3.0:1787862630.054128:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787862630.054141:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526428160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862630.054188:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862630.054248:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526428160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862630.054257:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787862630.054395:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862630.054437:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65099f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526428160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862630.087513:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.087812:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516981376 00000100:00100000:0.0:1787862630.087823:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516981376 00000100:00100000:0.0:1787862630.087891:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 149 00000100:00100000:0.0:1787862630.087902:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+34:11361:x1874709516981376:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862630.087931:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862630.087952:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf89306dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348d2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862630.088134:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787862630.088253:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf89306dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d2 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.088266:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:0.0:1787862630.088269:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862630.088275:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf89306dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d2 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.088287:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918600, rc 0) 00000100:00100000:0.0:1787862630.088345:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+35:11361:x1874709516981376:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 445us (843us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787862630.088368:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 149 00000100:00100000:1.0:1787862630.094121:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862630.094336:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516981504 00000100:00100000:3.0:1787862630.094348:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516981504 00000100:00100000:3.0:1787862630.094409:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 150 00000100:00100000:3.0:1787862630.094420:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+35:11361:x1874709516981504:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:3.0:1787862630.094517:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094534:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094545:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094560:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094567:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094574:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094699:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094707:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094714:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862630.094758:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094771:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094778:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094785:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094791:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862630.094796:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094805:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094817:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:3.0:1787862630.094820:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862630.094825:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094838:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89306ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094853:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094858:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094863:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094868:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862630.094871:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094876:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094883:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517c53200) 00010000:00010000:3.0:1787862630.094885:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862630.094887:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094892:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89306f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094904:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094911:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094921:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094926:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862630.094929:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094935:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094941:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:3.0:1787862630.094943:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862630.094946:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.094951:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89306f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862630.095095:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+35:11361:x1874709516981504:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 625us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862630.095574:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 150 00000100:00100000:1.0:1787862630.098538:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862630.098696:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516981760 00000100:00100000:3.0:1787862630.098706:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516981760 00000100:00100000:3.0:1787862630.098772:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:3.0:1787862630.098784:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+35:11361:x1874709516981760:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862630.100327:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+36:11361:x1874709516981760:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 1538us (1791us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787862630.100338:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:2.0:1787862630.145542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.146596:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516982016 00000100:00100000:0.0:1787862630.146607:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516982016 00000100:00100000:0.0:1787862630.146680:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 151 00000100:00100000:0.0:1787862630.146691:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+36:11364:x1874709516982016:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862630.146717:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862630.146738:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf89306ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348d9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.146827:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.146842:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.146854:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.146870:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.146877:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.146884:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.147030:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.147038:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.147826:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862630.147840:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787862630.149988:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150005:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150013:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150020:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862630.150024:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150033:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150075:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862630.150078:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862630.150084:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150090:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150176:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150184:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150189:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150209:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862630.150212:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150218:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150226:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517dfc500) 00010000:00010000:2.0:1787862630.150229:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862630.150232:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150238:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf893070d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150291:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf89306ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150305:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.150378:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862630.150381:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862630.150384:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031800, rc 0) 00000100:00100000:2.0:1787862630.150585:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+38:11364:x1874709516982016:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 3894us (5052us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787862630.150595:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 151 00000100:00100000:1.0:1787862630.156250:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.156303:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516982144 00000100:00100000:0.0:1787862630.156323:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516982144 00000100:00100000:0.0:1787862630.156419:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 152 00000100:00100000:0.0:1787862630.156430:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+38:11364:x1874709516982144:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:0.0:1787862630.156513:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156533:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156545:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156574:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156581:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156588:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156606:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862630.156610:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156617:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156630:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862630.156633:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862630.156638:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.156644:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862630.156742:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+38:11364:x1874709516982144:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 313us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862630.156759:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 152 00000100:00100000:1.0:1787862630.160387:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862630.160544:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516982400 00000100:00100000:3.0:1787862630.160556:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516982400 00000100:00100000:3.0:1787862630.160619:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:3.0:1787862630.160631:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+38:11364:x1874709516982400:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862630.160909:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+39:11364:x1874709516982400:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 280us (533us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787862630.160918:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:3.0:1787862630.697702:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.698166:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516982656 00000100:00100000:0.0:1787862630.698187:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516982656 00000100:00100000:0.0:1787862630.698249:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 153 00000100:00100000:0.0:1787862630.698259:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+39:11395:x1874709516982656:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:0.0:1787862630.698283:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862630.698303:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348e0 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.698402:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.698437:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.698453:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862630.698465:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787862630.698642:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e0 expref: 42 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.698664:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e0 expref: 41 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.698683:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862630.698686:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862630.698690:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787862630.699477:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+41:11395:x1874709516982656:12345-192.168.202.60@tcp:101:cat.0 Request processed in 1205us (1770us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787862630.699495:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 153 00000100:00100000:1.0:1787862630.704353:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.704809:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516982912 00000100:00100000:0.0:1787862630.704819:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516982912 00000100:00100000:0.0:1787862630.704936:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:0.0:1787862630.704946:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+41:11395:x1874709516982912:12345-192.168.202.60@tcp:35:cat.0 00000100:00100000:0.0:1787862630.707111:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+42:11395:x1874709516982912:12345-192.168.202.60@tcp:35:cat.0 Request processed in 2147us (2749us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787862630.707125:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1787862630.710088:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.710241:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516983040 00000100:00100000:0.0:1787862630.710267:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516983040 00000100:00100000:0.0:1787862630.710334:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:0.0:1787862630.710344:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6512572450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+42:2348:x1874709516983040:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862630.710359:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862630.710385:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e0 expref: 42 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.710405:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862630.710409:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862630.710453:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6512572450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+41:2348:x1874709516983040:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862630.710460:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:1.0:1787862630.912168:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.917621:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516983296 00000100:00100000:0.0:1787862630.917637:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516983296 00000100:00100000:0.0:1787862630.917726:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 154 00000100:00100000:0.0:1787862630.917737:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+41:11401:x1874709516983296:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:0.0:1787862630.917763:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862630.917767:0:12007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787862630.917794:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348b6 expref: 41 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.917817:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862630.917823:0:12007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862630.918596:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893073e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348e7 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.918712:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.918741:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.918750:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.918782:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.918797:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 41 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862630.918811:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526428288:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862630.919743:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862630.927526:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862630.927633:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526428288:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862630.927693:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862630.927844:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516983424 00000100:00100000:3.0:1787862630.927853:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516983424 00010000:00010000:3.0:1787862630.927915:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 42 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862630.927960:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:3.0:1787862630.927971:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+42:2348:x1874709516983424:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862630.927988:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862630.927997:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 42 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.928022:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 42 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.928114:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348d9 expref: 42 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.928133:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:3.0:1787862630.928146:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.928157:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.928184:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862630.928230:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862630.928529:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+41:2348:x1874709516983424:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 558us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862630.928546:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00010000:00010000:2.0:1787862630.928569:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.928579:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862630.928600:0:12007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787862630.928793:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893073e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 42 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.928811:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 41 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.928820:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862630.928823:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862630.928825:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031c00, rc 0) 00000100:00100000:2.0:1787862630.928870:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+41:11401:x1874709516983296:12345-192.168.202.60@tcp:101:dd.0 Request processed in 11135us (16711us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787862630.928878:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 154 00000100:00100000:2.0:1787862630.934687:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862630.934798:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516983680 00000100:00100000:0.0:1787862630.934811:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516983680 00000100:00100000:0.0:1787862630.934887:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 155 00000100:00100000:0.0:1787862630.935008:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+41:11401:x1874709516983680:12345-192.168.202.60@tcp:36:dd.0 00010000:00010000:0.0:1787862630.935384:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.935417:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862630.935437:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862630.935510:0:7147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787862630.935567:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea5c9365 reply state 00000000d5ffa439 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862630.935577:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862630.935687:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+44:11401:x1874709516983680:12345-192.168.202.60@tcp:36:dd.0 Request processed in 683us (1009us total) trans 4294967441 rc 0/0 00010000:00010000:2.0:1787862630.943651:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.943679:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.943687:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.943716:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862630.943721:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.943737:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.943758:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862630.943769:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862630.943776:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862630.943784:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930753 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862630.949219:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 155 00000020:00080000:0.0:1787862630.949236:0:7147:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862631.004927:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862631.325678:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862631.329346:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516983808 00000100:00100000:0.0:1787862631.329364:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516983808 00000100:00100000:0.0:1787862631.329473:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 156 00000100:00100000:0.0:1787862631.329487:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+43:11415:x1874709516983808:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:0.0:1787862631.329519:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862631.329547:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf893075a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348ee expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329632:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329648:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329665:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329679:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329685:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329711:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329818:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329829:0:12008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 44 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329837:0:12008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329872:0:12008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 44 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.329888:0:12008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 44 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862631.329903:0:12008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526428416:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862631.330023:0:12008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f300 going to sleep for 11 seconds 00000100:00080000:2.0:1787862631.330234:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862631.333614:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862631.333768:0:12008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526428416:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862631.333800:0:12008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862631.334176:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516984064 00000100:00100000:3.0:1787862631.334192:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516984064 00000100:00100000:3.0:1787862631.334342:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:3.0:1787862631.334357:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+45:5588:x1874709516984064:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787862631.334891:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+46:5588:x1874709516984064:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 526us (1277us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787862631.334903:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:1.0:1787862631.338613:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862631.338861:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516984192 00000100:00100000:0.0:1787862631.338938:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516984192 00010000:00010000:0.0:1787862631.338998:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 46 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862631.339178:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:0.0:1787862631.339192:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+46:2349:x1874709516984192:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862631.339215:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862631.339224:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 46 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.339239:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 46 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.339268:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930745 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348e7 expref: 46 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.339291:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862631.339299:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.339312:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.339321:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.339370:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862631.339432:0:12008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339448:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862631.339466:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+45:2349:x1874709516984192:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 276us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862631.339476:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00000004:00200000:1.0:1787862631.339505:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787862631.339512:0:12008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862631.339566:0:12008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339585:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339596:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339603:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339610:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339616:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862631.339621:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339628:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339644:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862631.339647:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862631.339652:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339659:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339676:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339682:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339695:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339701:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862631.339705:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339712:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339721:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517dfc200) 00010000:00010000:1.0:1787862631.339724:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862631.339728:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339734:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339779:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf893075a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348ee expref: 45 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339793:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348ee expref: 44 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862631.339801:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:1.0:1787862631.339803:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862631.339806:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:1.0:1787862631.339882:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+44:11415:x1874709516983808:12345-192.168.202.60@tcp:101:stat.0 Request processed in 10399us (14217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862631.339900:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 156 00000100:00100000:1.0:1787862631.420896:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862631.421142:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516984448 00000100:00100000:2.0:1787862631.421159:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516984448 00000100:00100000:2.0:1787862631.421316:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 157 00000100:00100000:2.0:1787862631.421331:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+44:11421:x1874709516984448:12345-192.168.202.60@tcp:36:truncate.0 00010000:00010000:2.0:1787862631.421428:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862631.421466:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf893076f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348ee expref: 44 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.421511:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862631.421517:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862631.421837:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.421875:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.421887:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862631.421957:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787862631.421987:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f8db1af reply state 000000006cc1d8b5 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862631.421998:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862631.422222:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+46:11421:x1874709516984448:12345-192.168.202.60@tcp:36:truncate.0 Request processed in 893us (1339us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787862631.422232:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 157 00000020:00080000:2.0:1787862631.422240:0:5817:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787862631.426348:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.426389:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.426398:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.426405:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862631.426411:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.426419:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.426439:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862631.426442:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862631.426448:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.426456:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930776 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862631.615358:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.615665:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516984576 00000100:00100000:3.0:1787862631.615680:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516984576 00000100:00100000:3.0:1787862631.615775:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 158 00000100:00100000:3.0:1787862631.615789:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+45:11435:x1874709516984576:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:3.0:1787862631.615824:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862631.615853:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893077d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.615942:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.615961:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.615997:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616015:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616023:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616029:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616187:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616196:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616203:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862631.616246:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787862631.616251:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862631.616277:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616290:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616300:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616545:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616553:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616561:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862631.616566:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616575:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616590:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:3.0:1787862631.616594:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862631.616600:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616607:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8930784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616623:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616629:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616635:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616641:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862631.616649:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616656:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616664:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517c53200) 00010000:00010000:3.0:1787862631.616666:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862631.616669:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616676:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf893078b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616710:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893077d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616724:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.616743:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:3.0:1787862631.616747:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862631.616750:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d400, rc 0) 00000100:00100000:3.0:1787862631.616845:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+46:11435:x1874709516984576:12345-192.168.202.60@tcp:101:stat.0 Request processed in 1059us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862631.616854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 158 00000100:00100000:2.0:1787862631.719827:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.720901:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516984832 00000100:00100000:3.0:1787862631.720927:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516984832 00000100:00100000:3.0:1787862631.721070:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 159 00000100:00100000:3.0:1787862631.721085:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+46:11445:x1874709516984832:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862631.721148:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862631.721180:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b348fc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862631.721348:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787862631.721499:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930799 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348fc expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.721516:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:3.0:1787862631.721520:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862631.721525:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348fc expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.721540:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d200, rc 0) 00000100:00100000:3.0:1787862631.721643:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+47:11445:x1874709516984832:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 562us (1836us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787862631.721651:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 159 00000100:00100000:2.0:1787862631.732843:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862631.732963:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516985088 00000100:00100000:0.0:1787862631.732978:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516985088 00000100:00100000:0.0:1787862631.733183:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:0.0:1787862631.733200:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+47:11445:x1874709516985088:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862631.737235:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+48:11445:x1874709516985088:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 1131us (1502us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787862631.737264:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:2.0:1787862631.853090:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862631.853302:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516985344 00000100:00100000:0.0:1787862631.853356:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516985344 00000100:00100000:0.0:1787862631.853445:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 160 00000100:00100000:0.0:1787862631.853458:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+48:11451:x1874709516985344:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862631.853495:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862631.853528:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89307a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34903 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.853714:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.853733:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 49 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.853744:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.853796:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 49 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.853813:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 49 pid: 5815 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862631.853833:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526428544:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862631.853978:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862631.870151:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.870950:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516985472 00000100:00100000:3.0:1787862631.870966:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516985472 00010000:00010000:3.0:1787862631.871074:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 50 pid: 5815 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862631.871133:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:3.0:1787862631.871148:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+50:2348:x1874709516985472:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862631.871175:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862631.871185:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 50 pid: 5815 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.871227:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 50 pid: 5815 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.871260:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:3.0:1787862631.871267:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.871279:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.871287:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.871312:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862631.871608:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+50:2348:x1874709516985472:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 461us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862631.871619:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00010000:00010000:0.0:1787862631.873508:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b348f5 expref: 49 pid: 5815 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862631.873544:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526428544:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862631.873610:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.873622:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.873628:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862631.873658:0:12007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787862631.873914:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89307a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 50 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.873935:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 49 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862631.873945:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862631.873948:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862631.873952:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787862631.874126:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+49:11451:x1874709516985344:12345-192.168.202.60@tcp:101:bash.0 Request processed in 20669us (21118us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787862631.874137:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 160 00000100:00100000:2.0:1787862631.883028:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.883296:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516985728 00000100:00100000:3.0:1787862631.883313:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516985728 00000100:00100000:3.0:1787862631.883408:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 161 00000100:00100000:3.0:1787862631.883420:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+49:11451:x1874709516985728:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:3.0:1787862631.883972:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.883997:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.884011:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862631.884152:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787862631.884188:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc385505 reply state 00000000627e0cfd transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862631.884199:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862631.884874:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+52:11451:x1874709516985728:12345-192.168.202.60@tcp:36:bash.0 Request processed in 1450us (1869us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787862631.884885:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 161 00000020:00080000:3.0:1787862631.884893:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787862631.906778:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.906806:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.906815:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.906822:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862631.906851:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.906861:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.906885:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862631.906888:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862631.906894:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.906901:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89307bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862631.909652:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.910880:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516985856 00000100:00100000:3.0:1787862631.910900:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516985856 00000100:00100000:3.0:1787862631.911151:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 162 00000100:00100000:3.0:1787862631.911168:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+51:11451:x1874709516985856:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862631.911205:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862631.911237:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89307c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3490a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.911380:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.911400:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 52 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.911411:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.911462:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 52 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.911503:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 52 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862631.911522:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65099f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526428672:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862631.911652:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651039c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862631.923095:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65099f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526428672:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862631.923147:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862631.930008:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.930717:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516985984 00000100:00100000:3.0:1787862631.930744:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516985984 00010000:00010000:3.0:1787862631.930802:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 53 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862631.930861:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:3.0:1787862631.930874:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:2349:x1874709516985984:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862631.930891:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862631.930899:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 53 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.930917:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 53 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.930946:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89307ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34903 expref: 53 pid: 12007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.930967:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:3.0:1787862631.930972:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.931005:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.931014:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862631.931101:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862631.931187:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+52:2349:x1874709516985984:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 315us (1194us total) trans 0 rc 0/0 00010000:00010000:2.0:1787862631.931191:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862631.931196:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 69 00010000:00010000:2.0:1787862631.931200:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862631.931264:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787862631.931270:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862631.931300:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.931727:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89307c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3490a expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.931758:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3490a expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862631.931782:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862631.931785:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862631.931789:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ce00, rc 0) 00000100:00100000:2.0:1787862631.931843:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+51:11451:x1874709516985856:12345-192.168.202.60@tcp:101:bash.0 Request processed in 20680us (22210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862631.931851:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 162 00000100:00100000:2.0:1787862631.936823:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862631.937099:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516986240 00000100:00100000:3.0:1787862631.937113:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516986240 00000100:00100000:3.0:1787862631.937250:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1787862631.937262:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+51:11451:x1874709516986240:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:3.0:1787862631.937613:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+52:11451:x1874709516986240:12345-192.168.202.60@tcp:35:bash.0 Request processed in 353us (806us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787862631.937622:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:1.0:1787862632.024266:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862632.024910:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516986496 00000100:00100000:2.0:1787862632.024923:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516986496 00000100:00100000:2.0:1787862632.025007:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 163 00000100:00100000:2.0:1787862632.025032:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+52:11461:x1874709516986496:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862632.025103:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862632.025136:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89307d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34911 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862632.025317:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787862632.025604:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89307d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34911 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.025620:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:2.0:1787862632.025622:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862632.025627:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89307d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34911 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.025641:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:2.0:1787862632.025735:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+53:11461:x1874709516986496:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 705us (1489us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787862632.025754:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 163 00010000:00010000:1.0:1787862632.028564:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862632.028806:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862632.028924:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516986624 00000100:00100000:2.0:1787862632.028939:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516986624 00000100:00100000:2.0:1787862632.029091:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 164 00000100:00100000:2.0:1787862632.029104:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+53:11461:x1874709516986624:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:2.0:1787862632.029214:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029234:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029249:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029268:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029276:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029283:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029420:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029431:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029438:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862632.029537:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029554:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029561:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029568:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029573:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862632.029578:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029587:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029603:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862632.029606:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862632.029611:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029618:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89307df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029636:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029643:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029655:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029660:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862632.029663:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029669:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029689:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6507fe6a00) 00010000:00010000:2.0:1787862632.029691:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862632.029694:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029699:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89307e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029730:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029737:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029744:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029749:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862632.029752:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029769:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029779:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862632.029781:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862632.029784:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862632.029790:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89307ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862632.029910:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+53:11461:x1874709516986624:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 806us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862632.029919:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 164 00000100:00100000:1.0:1787862632.036400:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862632.036428:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516986880 00000100:00100000:0.0:1787862632.036441:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516986880 00000100:00100000:0.0:1787862632.036629:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1787862632.036657:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+53:11461:x1874709516986880:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862632.037010:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+54:11461:x1874709516986880:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 354us (625us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787862632.037020:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:1.0:1787862632.073631:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862632.074071:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516987136 00000100:00100000:0.0:1787862632.074086:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516987136 00000100:00100000:0.0:1787862632.074176:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00100000:0.0:1787862632.074190:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+54:11464:x1874709516987136:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862632.074229:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862632.074263:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf89307f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34918 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.074388:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.074409:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.074423:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.074442:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.074449:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.074456:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.075922:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.075941:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.075954:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862632.075966:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787862632.076146:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076154:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076162:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076169:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862632.076174:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076183:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076199:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862632.076202:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862632.076208:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076231:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf89307fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076252:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076259:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076265:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076271:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862632.076274:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076282:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076291:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517dfc800) 00010000:00010000:0.0:1787862632.076294:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862632.076297:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076303:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076372:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf89307f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34918 expref: 57 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076405:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34918 expref: 56 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.076414:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862632.076417:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862632.076419:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787862632.077231:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+56:11464:x1874709516987136:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 3034us (3609us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787862632.077245:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00100000:2.0:1787862632.083718:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862632.083801:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516987264 00000100:00100000:0.0:1787862632.083816:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516987264 00000100:00100000:2.0:1787862632.083876:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862632.083909:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 166 00000100:00100000:0.0:1787862632.083923:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+56:11464:x1874709516987264:12345-192.168.202.60@tcp:54:lfs.0 00000100:00100000:1.0:1787862632.083977:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516987392 00000100:00100000:1.0:1787862632.083981:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516987392 00010000:00010000:0.0:1787862632.084032:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862632.084065:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1787862632.084075:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+57:2347:x1874709516987392:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862632.084089:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862632.084096:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.084111:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.087178:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.087203:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.087243:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.089258:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862632.089266:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34918 expref: 57 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.089273:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.089284:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.089297:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:0.0:1787862632.089300:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862632.089307:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.089315:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862632.089609:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+56:11464:x1874709516987264:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 5686us (5904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862632.089622:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 166 00010000:00010000:1.0:1787862632.089829:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:1.0:1787862632.089834:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862632.089858:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+55:2347:x1874709516987392:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 5786us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862632.089867:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787862632.093026:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.093184:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516987648 00000100:00100000:3.0:1787862632.093200:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516987648 00000100:00100000:3.0:1787862632.093270:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:3.0:1787862632.093282:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+55:11464:x1874709516987648:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862632.094884:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:11464:x1874709516987648:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 1588us (1858us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787862632.094904:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:2.0:1787862632.337655:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.337801:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516987904 00000100:00100000:3.0:1787862632.337831:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516987904 00000100:00100000:3.0:1787862632.337922:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:3.0:1787862632.337935:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:11482:x1874709516987904:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:3.0:1787862632.337972:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862632.338005:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf893081e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3491f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.338218:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930825 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.338241:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.338260:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930825 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862632.338276:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787862632.338502:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf893081e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3491f expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.338528:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930825 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3491f expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.338542:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:3.0:1787862632.338545:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787862632.338552:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422da00, rc 0) 00000100:00100000:3.0:1787862632.338665:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+58:11482:x1874709516987904:12345-192.168.202.60@tcp:101:cat.0 Request processed in 732us (1029us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787862632.338674:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:2.0:1787862632.388579:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862632.388729:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516988032 00000100:00100000:0.0:1787862632.388752:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516988032 00000100:00100000:0.0:1787862632.388837:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 168 00000100:00100000:0.0:1787862632.388851:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+58:11483:x1874709516988032:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862632.388890:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862632.388919:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34926 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.389070:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893083a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.389089:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893083a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.389104:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893083a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862632.389197:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787862632.389202:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862632.389230:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893083a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.389262:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34926 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.389288:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893083a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34926 expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862632.389298:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862632.389301:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862632.389306:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030c00, rc 0) 00000100:00100000:0.0:1787862632.389399:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+59:11483:x1874709516988032:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 550us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862632.389407:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 168 00000100:00100000:1.0:1787862632.400282:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.400448:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516988416 00000100:00100000:3.0:1787862632.400461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516988416 00000100:00100000:3.0:1787862632.400543:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1787862632.400555:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+59:11483:x1874709516988416:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862632.402216:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+60:11483:x1874709516988416:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 1653us (1941us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787862632.402232:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:2.0:1787862632.410028:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862632.410234:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516988544 00000100:00100000:1.0:1787862632.410248:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516988544 00000100:00100000:1.0:1787862632.411918:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:1.0:1787862632.411953:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+60:11483:x1874709516988544:12345-192.168.202.60@tcp:103:lfs.0 00010000:00010000:1.0:1787862632.411980:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787862632.412066:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89307ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3490a expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862632.412099:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf8930825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3491f expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862632.412114:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf89306d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b348cb expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862632.412127:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6b00) 00010000:00010000:1.0:1787862632.412143:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862632.412662:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+57:11483:x1874709516988544:12345-192.168.202.60@tcp:103:lfs.0 Request processed in 726us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862632.412674:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:2.0:1787862632.425947:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.426102:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516988672 00000100:00100000:3.0:1787862632.426116:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516988672 00000100:00100000:3.0:1787862632.426191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 169 00000100:00100000:3.0:1787862632.426204:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+57:11483:x1874709516988672:12345-192.168.202.60@tcp:58:lfs.0 00010000:00010000:3.0:1787862632.426396:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.426428:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.426443:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862632.426845:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787862632.427026:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+57:11483:x1874709516988672:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 823us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862632.427095:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 169 00000100:00100000:2.0:1787862632.474700:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.474958:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516988800 00000100:00100000:3.0:1787862632.474973:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516988800 00000100:00100000:3.0:1787862632.475083:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 170 00000100:00100000:3.0:1787862632.475097:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+57:11485:x1874709516988800:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862632.475155:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862632.475187:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3492d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475279:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475300:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475316:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475413:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475422:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475431:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475564:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475572:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475579:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862632.475624:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787862632.475637:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862632.475663:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475694:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475703:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475710:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475717:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475724:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862632.475728:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475737:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475752:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:3.0:1787862632.475756:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862632.475762:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475769:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf893084f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475786:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475802:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475809:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475814:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422de00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862632.475818:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475824:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475833:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517c53600) 00010000:00010000:3.0:1787862632.475835:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862632.475838:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475843:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475883:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475898:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862632.475905:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862632.475908:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862632.475917:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:3.0:1787862632.476595:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+58:11485:x1874709516988800:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1495us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862632.476607:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 170 00000100:00100000:3.0:1787862632.670169:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.670300:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989056 00000100:00100000:3.0:1787862632.670313:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989056 00000100:00100000:3.0:1787862632.670404:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:3.0:1787862632.670431:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516989056:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862632.670541:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516989056:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862632.670551:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00080000:3.0:1787862632.670586:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862632.670633:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.670740:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.670775:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862632.670802:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516988928 00000100:00100000:3.0:1787862632.670807:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516988928 00000100:00100000:3.0:1787862632.672313:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 306 00000100:00100000:3.0:1787862632.672511:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516988928:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862632.672670:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2349:x1874709516988928:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 177us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862632.672679:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 306 00000100:00100000:3.0:1787862632.672757:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989184 00000100:00100000:3.0:1787862632.672767:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989184 00000100:00100000:3.0:1787862632.672825:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:3.0:1787862632.672833:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516989184:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862632.673286:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516989184:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 449us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862632.673294:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00080000:3.0:1787862632.673576:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862632.673596:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989312 00000100:00100000:3.0:1787862632.673603:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989312 00000100:00080000:3.0:1787862632.673631:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862632.673712:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 175 00000100:00100000:3.0:1787862632.673722:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516989312:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862632.673765:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+5:2348:x1874709516989312:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 46us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862632.673773:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 175 00000001:00080000:3.0:1787862632.800637:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787862632.800663:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:1.0:1787862633.053857:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862633.119985:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526428800:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.120132:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.120196:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526429312:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.120231:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.120264:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862633.120270:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526429184:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.120297:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.121754:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526428928:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.121818:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.121842:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526429440:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.122998:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.123096:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862633.123109:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526429056:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.123161:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.123222:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526428800 00000100:00100000:1.0:1787862633.123233:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526428800 00000100:00100000:1.0:1787862633.124659:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787862633.124688:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.124822:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526428800:12345-0@lo:400:kworker.0 Request processed in 145us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.124832:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787862633.125620:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526429312 00000100:00100000:1.0:1787862633.125634:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526429312 00000100:00100000:1.0:1787862633.125698:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787862633.125706:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526429312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.125762:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526429312:12345-0@lo:400:kworker.0 Request processed in 59us (5530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.125769:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787862633.125783:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526428928 00000100:00100000:1.0:1787862633.125787:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526428928 00000100:00100000:1.0:1787862633.125807:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526429056 00000100:00100000:1.0:1787862633.125810:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526429056 00000100:00100000:1.0:1787862633.125831:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787862633.125836:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526428928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.127607:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526428928:12345-0@lo:400:kworker.0 Request processed in 1755us (5773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.127626:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787862633.127668:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787862633.127684:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526429056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.127794:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526429056:12345-0@lo:400:kworker.0 Request processed in 117us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.127802:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787862633.127833:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526429184 00000100:00100000:1.0:1787862633.127842:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526429184 00000100:00100000:1.0:1787862633.129198:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526429440 00000100:00100000:1.0:1787862633.129214:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526429440 00000100:00100000:1.0:1787862633.129259:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787862633.129270:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526429184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.129356:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526429184:12345-0@lo:400:kworker.0 Request processed in 89us (9057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.129364:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787862633.129383:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787862633.129390:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526429440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.130856:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526429440:12345-0@lo:400:kworker.0 Request processed in 1455us (7852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.131187:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787862633.131323:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526429184:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.131341:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526428800:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.131360:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526429312:0@lo:400:kworker.0 00000100:00080000:1.0:1787862633.131422:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862633.131431:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862633.131437:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862633.131480:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526429056:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.131632:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526428928:0@lo:400:kworker.0 00000100:00100000:1.0:1787862633.131659:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787862633.131666:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787862633.131685:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526429440:0@lo:400:kworker.0 00000040:00080000:1.0:1787862633.180277:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787862633.180292:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862633.180366:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787862633.180381:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862633.180645:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526429568:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862633.180933:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862633.197885:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.203007:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526429568:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787862633.203322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989440 00000100:00100000:3.0:1787862633.203334:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989440 00000100:00100000:3.0:1787862633.203428:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00100000:3.0:1787862633.203440:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+58:11496:x1874709516989440:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1787862633.203875:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1787862633.203975:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787862633.204799:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+58:11496:x1874709516989440:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 1353us (6923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862633.204812:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00100000:3.0:1787862633.215911:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.217625:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989568 00000100:00100000:1.0:1787862633.217649:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989568 00000100:00100000:1.0:1787862633.218179:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 172 00000100:00100000:1.0:1787862633.218195:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+58:11496:x1874709516989568:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787862633.218312:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218337:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218353:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218631:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218655:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218688:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218728:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218736:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218743:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862633.218791:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787862633.218796:0:7147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862633.218813:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218827:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218834:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218841:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218848:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862633.218852:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218860:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218878:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:1.0:1787862633.218881:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862633.218886:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218892:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930864 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218910:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218917:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218923:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218929:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862633.218932:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218939:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218948:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a6516880900) 00010000:00010000:1.0:1787862633.218950:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862633.218953:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218958:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf893086b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218984:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218990:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.218996:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.219001:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862633.219005:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.219011:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.219020:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:1.0:1787862633.219034:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862633.219038:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.219087:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf8930872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862633.219203:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+58:11496:x1874709516989568:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 1007us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.220436:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 172 00000001:00080000:1.0:1787862633.236193:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:1.0:1787862633.236258:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a650634fd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787862633.236266:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6509f1b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a650634f540 00000020:00080000:1.0:1787862633.236290:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6509f1ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a65030f3800 00000020:00080000:1.0:1787862633.236339:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787862633.237211:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1787862633.238315:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:3.0:1787862633.238357:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1787862633.238674:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.239145:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862633.239174:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526429696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787862633.239248:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862633.239309:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526429696 00000100:00100000:1.0:1787862633.239321:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526429696 00000100:00100000:1.0:1787862633.239392:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787862633.239405:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526429696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787862633.239445:0:6671:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00100000:3.0:1787862633.239884:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989824 00000100:00100000:3.0:1787862633.239891:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989824 00000100:00100000:3.0:1787862633.239939:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:3.0:1787862633.239949:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+17:11496:x1874709516989824:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862633.239968:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862633.239991:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930880 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34934 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.242296:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.242332:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.242354:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862633.242372:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00002000:00010000:1.0:1787862633.242807:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a909e65, atime: 0x6a909e65, ctime: 0x6a909e65, blocks: 0xb 00010000:00010000:1.0:1787862633.242822:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.242840:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1787862633.242846:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862633.242853:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.242869:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.242881:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.242890:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.242951:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862633.244295:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244315:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244323:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244330:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862633.244336:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244360:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244381:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862633.244385:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862633.244392:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244399:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8930887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.244475:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930880 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34934 expref: 19 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.244702:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862633.244719:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.244741:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862633.244746:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.244755:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.244773:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.244781:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45ed0ed/0x9c5536ccf8930879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.244806:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862633.244809:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862633.244811:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862633.246275:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526429696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6861us (7014us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787862633.246292:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1787862633.246447:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:3.0:1787862633.246452:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862633.246462:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf8930880 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34934 expref: 19 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.246480:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422de00, rc 0) 00000100:00100000:3.0:1787862633.246615:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516989824:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 6668us (7950us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787862633.246624:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 173 00000004:00080000:0.0:1787862633.246767:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a653dc8a580/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787862633.246775:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526429696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787862633.256502:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.256772:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516989952 00000100:00100000:3.0:1787862633.256787:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516989952 00000100:00100000:3.0:1787862633.256878:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 174 00000100:00100000:3.0:1787862633.256892:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516989952:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787862633.256957:0:12007:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787862633.257153:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516989952:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 264us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862633.257161:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 174 00000100:00100000:3.0:1787862633.268170:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.268264:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516990208 00000100:00100000:1.0:1787862633.268281:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516990208 00000100:00100000:1.0:1787862633.269439:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 175 00000100:00100000:1.0:1787862633.269457:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516990208:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862633.269705:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862633.269710:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787862633.269823:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893083a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34926 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.269852:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862633.269860:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862633.269883:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930895 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3493b expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862633.279388:0:7147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787862633.279908:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf893089c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.279933:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf893089c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.279951:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf893089c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.280105:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf8930895 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3493b expref: 20 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.280128:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf893089c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3493b expref: 19 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.280140:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880400) 00010000:00010000:1.0:1787862633.280143:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862633.280148:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ea00, rc 0) 00000100:00100000:1.0:1787862633.280253:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+19:11496:x1874709516990208:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 10799us (12103us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787862633.280265:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 175 00000100:00100000:0.0:1787862633.289989:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.290141:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516990464 00000100:00100000:1.0:1787862633.290157:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516990464 00000100:00100000:1.0:1787862633.290248:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 176 00000100:00100000:1.0:1787862633.290263:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+19:11496:x1874709516990464:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787862633.290369:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862633.290408:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ea00/0x9c5536ccf893089c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3493b expref: 19 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290430:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880400) 00010000:00010000:1.0:1787862633.290443:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862633.290480:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290499:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290527:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290548:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290556:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290563:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290924:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290934:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290941:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290948:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204f400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862633.290954:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290962:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290972:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862633.290976:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862633.290980:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.290993:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f400/0x9c5536ccf89308aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291004:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291010:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291016:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291021:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fa00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862633.291036:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291075:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291084:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x804809 (ffff9a6516880900) 00010000:00010000:1.0:1787862633.291087:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862633.291090:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.291096:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204fa00/0x9c5536ccf89308b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x804809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862633.291218:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516990464:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 957us (1243us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787862633.291227:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 176 00000100:00100000:0.0:1787862633.293973:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.294087:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516990592 00000100:00100000:1.0:1787862633.294101:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516990592 00000100:00100000:1.0:1787862633.294182:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 177 00000100:00100000:1.0:1787862633.294196:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516990592:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862633.294229:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862633.294260:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89308b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34942 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.294310:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.294329:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.294342:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.294482:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204f600/0x9c5536ccf89308b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 20 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.294512:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 19 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.294521:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:1.0:1787862633.294525:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787862633.294529:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a654204ee00, rc 0) 00000100:00100000:1.0:1787862633.294602:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+19:11496:x1874709516990592:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 409us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.294610:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 177 00000100:00100000:3.0:1787862633.296551:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.296615:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516990848 00000100:00100000:1.0:1787862633.296626:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516990848 00000100:00100000:1.0:1787862633.296696:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 178 00000100:00100000:1.0:1787862633.296709:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+19:11496:x1874709516990848:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787862633.296855:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.296876:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.296891:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862633.297352:0:7147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787862633.297366:0:7147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359061322177ns, next at 360061318857ns, rc = 0 00000004:00010000:1.0:1787862633.298614:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf3fbf57 reply state 00000000fa1d000b transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862633.298636:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862633.298844:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+21:11496:x1874709516990848:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 2132us (2301us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787862633.298856:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 178 00000100:00100000:1.0:1787862633.306390:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:2.0:1787862633.307368:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.307391:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.307401:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.307699:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862633.307707:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.307716:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.307826:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:2.0:1787862633.307830:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787862633.307838:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.307845:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf89308c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862633.310439:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516990976 00000100:00100000:3.0:1787862633.310467:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516990976 00000100:00100000:3.0:1787862633.310556:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 179 00000100:00100000:3.0:1787862633.310572:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+20:11496:x1874709516990976:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862633.310615:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862633.310651:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34949 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.310749:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 21 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.310769:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 21 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.310796:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:3.0:1787862633.310800:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787862633.310807:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422de00, rc 0) 00000100:00100000:0.0:1787862633.312822:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+21:11496:x1874709516990976:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 2236us (6442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.312840:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 179 00000100:00100000:2.0:1787862633.318290:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.319298:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516991104 00000100:00100000:0.0:1787862633.319324:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516991104 00000100:00100000:0.0:1787862633.319411:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1787862633.319425:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516991104:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787862633.319965:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516991104:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 540us (1690us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787862633.319976:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1787862633.325090:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862633.325292:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516991360 00000100:00100000:2.0:1787862633.325309:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516991360 00000100:00100000:2.0:1787862633.325409:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:2.0:1787862633.325424:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+21:11496:x1874709516991360:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862633.325818:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+22:11496:x1874709516991360:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 394us (743us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787862633.325829:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:1.0:1787862633.345855:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.348085:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516991616 00000100:00100000:3.0:1787862633.348110:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516991616 00000100:00100000:3.0:1787862633.348207:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 180 00000100:00100000:3.0:1787862633.348220:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+22:11496:x1874709516991616:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862633.348436:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+22:11496:x1874709516991616:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 218us (2604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862633.348447:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 180 00000100:00100000:2.0:1787862633.360944:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.361100:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516991744 00000100:00100000:3.0:1787862633.361116:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516991744 00000100:00100000:3.0:1787862633.361193:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 181 00000100:00100000:3.0:1787862633.361205:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+22:11496:x1874709516991744:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862633.361236:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862633.361265:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89308d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34950 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.361390:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89308db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.361700:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89308db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.361721:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89308db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862633.364639:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862633.364702:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89308db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.364779:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89308d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34950 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.364846:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89308db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34950 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.364859:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:1.0:1787862633.366789:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787862633.366803:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d400, rc 0) 00000100:00100000:1.0:1787862633.367037:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+23:11496:x1874709516991744:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 5816us (6095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862633.367067:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 181 00000100:00100000:0.0:1787862633.378744:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.378967:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516991872 00000100:00100000:3.0:1787862633.378984:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516991872 00000100:00100000:3.0:1787862633.379095:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:3.0:1787862633.379108:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516991872:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862633.379139:0:12006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862633.379174:0:12006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34957 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862633.379238:0:12006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909e69, blocks: 0x1 00010000:00010000:3.0:1787862633.379275:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1787862633.379283:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862633.379297:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 8 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.379328:0:12006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 8 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.379350:0:12006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c200, rc 0) 00000100:00100000:3.0:1787862633.379453:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516991872:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 346us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862633.379462:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:1.0:1787862633.389122:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.392365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516992128 00000100:00100000:0.0:1787862633.392390:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516992128 00000100:00100000:0.0:1787862633.392510:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 182 00000100:00100000:0.0:1787862633.392525:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+23:11496:x1874709516992128:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787862633.392941:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+23:11496:x1874709516992128:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 417us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.405089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 182 00000100:00100000:2.0:1787862633.410633:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.410835:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516992256 00000100:00100000:0.0:1787862633.410850:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516992256 00000100:00100000:0.0:1787862633.410937:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:0.0:1787862633.410951:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:11496:x1874709516992256:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862633.410981:0:11687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862633.411009:0:11687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3495e expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.411091:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.411120:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862633.411126:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862633.411133:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.411177:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.411194:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.411213:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526429824:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862633.411340:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862633.416167:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526429824:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862633.416225:0:11687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.416253:0:11687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031a00, rc 0) 00000100:00100000:0.0:1787862633.416345:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:11496:x1874709516992256:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 5396us (5727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.416358:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:2.0:1787862633.417581:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.417760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516992384 00000100:00100000:0.0:1787862633.417772:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516992384 00010000:00010000:0.0:1787862633.417827:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.417890:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:0.0:1787862633.417902:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6512570050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516992384:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862633.417924:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862633.417969:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.417986:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.418017:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89308e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34957 expref: 9 pid: 12006 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.418090:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862633.418097:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862633.418109:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.418121:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.418172:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.418189:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8440:1874709526429952:192.168.202.60@tcp:105: 00000100:00100000:0.0:1787862633.418295:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862633.425681:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8440:1874709526429952:192.168.202.60@tcp:105: 00010000:00010000:3.0:1787862633.425809:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862633.427636:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6512570050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516992384:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 9711us (10039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862633.427659:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:1.0:1787862633.435186:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862633.436956:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516992512 00000100:00100000:2.0:1787862633.436981:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516992512 00002000:00100000:2.0:1787862633.437152:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a653aa47840 x1874709516992512/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:749/0 lens 504/0 e 0 to 0 dl 1787862644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862633.437165:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a653aa47840 with x1874709516992512 ext(0->8) 00002000:00010000:2.0:1787862633.437173:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a653aa47840 00000100:00100000:2.0:1787862633.437209:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:2.0:1787862633.437218:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516992512:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787862633.438963:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:21567a16-68b5-41a8-a3f6-27f314a231da+10:2349:x1874709516992512:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 Request processed in 1728us (3777us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787862633.438987:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00002000:00100000:2.0:1787862633.439006:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a653aa47840 x1874709516992512/t4294967314(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:749/0 lens 504/448 e 0 to 0 dl 1787862644 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862633.439018:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a653aa47840 with x1874709516992512 ext(0->8) 00002000:00010000:2.0:1787862633.439038:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a653aa47840 00000100:00100000:2.0:1787862633.452194:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.452337:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516992640 00000100:00100000:0.0:1787862633.452355:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516992640 00000100:00100000:0.0:1787862633.452451:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00100000:0.0:1787862633.452467:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+23:11496:x1874709516992640:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787862633.510930:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1787862633.510958:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787862633.510980:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787862633.511213:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787862633.511227:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787862633.511252:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65099f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526430080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787862633.511374:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862633.511982:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+21:11496:x1874709516992640:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 59511us (59802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862633.511997:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 183 00000001:00080000:0.0:1787862633.512121:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:3.0:1787862633.519158:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526430080 00000100:00100000:3.0:1787862633.519184:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526430080 00000100:00100000:3.0:1787862633.519376:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787862633.519390:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526430080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787862633.519793:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.520388:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516992768 00000100:00100000:0.0:1787862633.520402:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516992768 00000100:00100000:0.0:1787862633.520460:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:0.0:1787862633.520482:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+10:2348:x1874709516992768:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00002000:00010000:3.0:1787862633.521183:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787862633.521189:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787862633 00002000:00010000:3.0:1787862633.521192:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787862633.521194:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787862633 -> 1787862633 00002000:00010000:3.0:1787862633.521196:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787862633.521320:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526430080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1930us (9943us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787862633.521330:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1787862633.521797:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a65099f7c00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787862633.521809:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65099f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526430080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787862633.636494:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862633.636539:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862633.636670:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862633.636978:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526430208 00000100:00100000:2.0:1787862633.636990:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526430208 00000100:00100000:2.0:1787862633.639165:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787862633.639192:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526430208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862633.639262:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862633.639377:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526430208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862633.639387:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787862633.639478:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526430208:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787862633.655012:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1787862633.655087:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1787862633.655102:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787862633.655449:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516992768:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 134959us (135648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.655464:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:1.0:1787862633.662453:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.663038:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516993024 00000100:00100000:3.0:1787862633.663098:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516993024 00000100:00100000:3.0:1787862633.663177:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 184 00000100:00100000:3.0:1787862633.663191:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401861a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+19:11496:x1874709516993024:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787862633.663275:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862633.663315:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf89308db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34950 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.663341:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:3.0:1787862633.663347:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862633.663396:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.663415:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.663441:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862633.664428:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7ce8d9f reply state 00000000c929e8e7 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862633.664448:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862633.665826:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401861a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+20:11496:x1874709516993024:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 2626us (3379us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787862633.665843:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 184 00010000:00010000:3.0:1787862633.673926:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.673947:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.673956:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.673963:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862633.673969:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.673977:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.674000:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:3.0:1787862633.674003:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862633.674009:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.674136:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf89308f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862633.674307:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.678563:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516993152 00000100:00100000:1.0:1787862633.678588:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516993152 00000100:00100000:1.0:1787862633.678683:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:1.0:1787862633.678697:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709516993152:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787862633.679340:0:11687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787862633.679347:0:11687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787862633 -> 1787862631 00002000:00010000:1.0:1787862633.679351:0:11687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787862629 00002000:00010000:1.0:1787862633.679354:0:11687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787862633 -> 1787862631 00002000:00010000:1.0:1787862633.679356:0:11687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787862633.679475:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516993152:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 778us (5171us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787862633.679489:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:1.0:1787862633.698332:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862633.702029:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516993408 00000100:00100000:2.0:1787862633.702078:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516993408 00000100:00100000:2.0:1787862633.702176:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 185 00000100:00100000:2.0:1787862633.702190:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+19:11496:x1874709516993408:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787862633.702310:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.702333:0:12008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 19 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.702343:0:12008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.702392:0:12008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 19 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.702408:0:12008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 19 pid: 12007 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862633.702426:0:12008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526430336:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862633.702604:0:12008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787862633.711186:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862633.713269:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516993536 00000100:00100000:3.0:1787862633.713292:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516993536 00010000:00010000:3.0:1787862633.713359:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 20 pid: 12007 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862633.713421:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:3.0:1787862633.713434:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401861e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:2349:x1874709516993536:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862633.713455:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862633.713464:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 20 pid: 12007 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.713481:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 20 pid: 12007 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.713514:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:3.0:1787862633.713521:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.713534:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.713543:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.713581:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862633.713665:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401861e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:2349:x1874709516993536:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 234us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862633.713675:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 71 00010000:00010000:2.0:1787862633.720010:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204ee00/0x9c5536ccf89308bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34942 expref: 19 pid: 12007 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862633.720073:0:12008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526430336:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862633.720110:0:12008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720121:0:12008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720127:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720177:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720185:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720193:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720201:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862633.720206:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720216:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720237:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:2.0:1787862633.720251:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787862633.720260:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.720267:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf89308f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862633.720402:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516993408:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 Request processed in 18214us (22087us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787862633.720414:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 185 00000100:00100000:0.0:1787862633.734635:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862633.734765:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516993664 00000100:00100000:2.0:1787862633.734781:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516993664 00000100:00100000:2.0:1787862633.734854:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:2.0:1787862633.734880:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516993664:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787862633.734947:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.734972:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.734982:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862633.734987:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862633.734993:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.735081:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.735120:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 8 pid: 11687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862633.735140:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526430464:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862633.735252:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6000 going to sleep for 11 seconds 00000040:00080000:3.0:1787862633.738202:0:12402:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862633.738218:0:12402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862633.738281:0:12402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787862633.738287:0:12402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862633.750114:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526430464:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862633.750164:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862633.753388:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862633.753614:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516993792 00000100:00100000:2.0:1787862633.753627:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516993792 00010000:00010000:2.0:1787862633.753693:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 9 pid: 11687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862633.753766:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:2.0:1787862633.753778:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401860780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516993792:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862633.753806:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862633.753841:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 9 pid: 11687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.753859:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 9 pid: 11687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.754028:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9928c1/0x9c5536ccf89308e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3495e expref: 9 pid: 11687 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.754088:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862633.754093:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862633.754115:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.754126:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.754167:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862633.754240:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401860780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516993792:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 463us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862633.754249:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 72 00010000:00010000:0.0:1787862633.754421:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754431:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754466:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754474:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754489:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754498:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862633.754504:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754515:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754530:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.754539:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b13de37/0x9c5536ccf89308fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.754606:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709516993664:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 19728us (19990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.754616:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:3.0:1787862633.758512:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.758784:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516994048 00000100:00100000:0.0:1787862633.758799:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516994048 00000100:00100000:0.0:1787862633.758887:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 186 00000100:00100000:0.0:1787862633.758898:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+18:11496:x1874709516994048:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787862633.759010:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759085:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759100:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759433:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759446:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 19 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759456:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759505:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 19 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.759526:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 19 pid: 12008 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.759545:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526430592:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862633.759678:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862633.780316:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526430592:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862633.780365:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862633.793537:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.793692:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516994176 00000100:00100000:0.0:1787862633.793715:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516994176 00010000:00010000:0.0:1787862633.793792:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 20 pid: 12008 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.793855:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:0.0:1787862633.793869:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:2349:x1874709516994176:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862633.793890:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862633.793898:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 20 pid: 12008 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.793916:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 20 pid: 12008 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.793948:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422de00/0x9c5536ccf89308cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34949 expref: 20 pid: 12008 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.793972:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:0.0:1787862633.793980:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.793992:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.794001:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.794076:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862633.794168:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:2349:x1874709516994176:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 302us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.794188:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00010000:00010000:2.0:1787862633.794849:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862633.794873:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862633.795216:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787862633.795422:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787862633.795479:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787862633.795603:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460e940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526430720:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787862633.795710:0:12007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862633.795776:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862633.796111:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526430720 00000100:00100000:0.0:1787862633.796121:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526430720 00000100:00100000:0.0:1787862633.796193:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862633.796206:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12007:x1874709526430720:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787862633.796332:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12007:x1874709526430720:12345-0@lo:1000:mdt00_004.0 Request processed in 129us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.796340:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862633.796390:0:12007:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787862633.796397:0:12007:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a65099f7c00, transno 4294967315 00000100:00100000:0.0:1787862633.796416:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460e940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526430720:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787862633.797107:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787862633.797207:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526430848:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787862633.797281:0:12007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862633.797313:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862633.797569:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526430848 00000100:00100000:0.0:1787862633.797577:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526430848 00000100:00100000:0.0:1787862633.797615:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862633.797624:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12007:x1874709526430848:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787862633.797836:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12007:x1874709526430848:12345-0@lo:1000:mdt00_004.0 Request processed in 213us (554us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787862633.797844:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862633.797889:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526430848:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787862633.797938:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.797964:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.797974:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.797981:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862633.797987:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.797996:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798033:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880500) 00010000:00010000:0.0:1787862633.798037:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862633.798070:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798077:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893090c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798121:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798127:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798133:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798138:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862633.798148:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798155:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798164:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:0.0:1787862633.798167:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862633.798170:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798176:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c800/0x9c5536ccf8930841 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798205:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798223:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798232:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798265:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.798281:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 22 pid: 5815 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.798294:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5f840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526430976:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862633.798388:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e21e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862633.832762:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862633.841169:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5f840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526430976:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862633.841219:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.841259:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516994304 00000100:00100000:0.0:1787862633.841269:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516994304 00010000:00010000:0.0:1787862633.841332:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 23 pid: 5815 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862633.841380:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:0.0:1787862633.841393:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+23:2346:x1874709516994304:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862633.841419:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862633.841428:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 23 pid: 5815 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.841444:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 23 pid: 5815 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.841478:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893085d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3492d expref: 23 pid: 5815 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.841498:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:0.0:1787862633.841506:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.841520:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.841531:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862633.841590:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862633.841687:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+22:2346:x1874709516994304:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 295us (8941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862633.841698:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 74 00010000:00010000:3.0:1787862633.842521:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842535:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842551:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842558:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842566:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842587:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862633.842593:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842602:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842617:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862633.842620:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862633.842625:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842631:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930913 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842646:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842652:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842658:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842663:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862633.842666:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842672:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842691:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:3.0:1787862633.842693:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862633.842697:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.842703:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031800/0x9c5536ccf8930905 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862633.843066:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+21:11496:x1874709516994048:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 84145us (84544us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787862633.843078:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 186 00000020:00080000:3.0:1787862633.843086:0:12007:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787862633.843235:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862633.843242:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862633.843737:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787862633.843746:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862633.858197:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862633.860086:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516994560 00000100:00100000:1.0:1787862633.860111:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516994560 00000100:00100000:1.0:1787862633.860218:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:1.0:1787862633.860232:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:11496:x1874709516994560:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787862633.863557:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787862633.863687:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787862633.863794:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.863820:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.863837:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.863848:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.863856:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.867230:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.867311:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787862633.867548:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+23:11496:x1874709516994560:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 7310us (9362us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787862633.867565:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00000020:00080000:1.0:1787862633.867588:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862633.873621:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862633.873645:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.873658:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862633.873663:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.873677:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.873704:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6516880400) 00010000:00010000:3.0:1787862633.873707:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862633.874586:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862633.874598:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78800/0x9c5536ccf893091a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862633.878676:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862633.878690:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862633.878694:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862634.081249:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862635.100682:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862635.169439:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862635.169470:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526431104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862635.169582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862635.169676:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526431104 00000100:00100000:3.0:1787862635.169686:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526431104 00000100:00100000:3.0:1787862635.170026:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862635.170070:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526431104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862635.170110:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787862635.170845:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526431104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 802us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862635.170934:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787862635.171086:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526431104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787862635.171906:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787862636.131458:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862636.368455:0:12453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862636.368473:0:12453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862636.368541:0:12453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787862636.368548:0:12453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862636.586381:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862636.586483:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516994816 00000100:00100000:1.0:1787862636.586500:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516994816 00000100:00100000:1.0:1787862636.586613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:1.0:1787862636.586624:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+23:11515:x1874709516994816:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862636.586660:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862636.586699:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34965 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787862636.587150:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862636.587162:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79200/0x9c5536ccf8930928 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.587181:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79200/0x9c5536ccf8930928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.587200:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79200/0x9c5536ccf8930928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862636.587221:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787862636.587441:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34965 expref: 26 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.587463:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79200/0x9c5536ccf8930928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34965 expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.587473:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862636.587484:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862636.587491:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79200, rc 0) 00000100:00100000:1.0:1787862636.587971:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+25:11515:x1874709516994816:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1346us (1604us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787862636.587983:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:2.0:1787862636.591988:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862636.592135:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516994944 00000100:00100000:1.0:1787862636.592150:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516994944 00000100:00100000:1.0:1787862636.592238:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 188 00000100:00100000:1.0:1787862636.592251:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+25:11515:x1874709516994944:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:1.0:1787862636.592352:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.592371:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.592382:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.592394:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.592399:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.592403:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593209:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593221:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593238:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862636.593297:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593311:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593316:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593322:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593326:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862636.593329:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593335:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593347:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862636.593349:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862636.593356:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593359:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930936 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593370:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593379:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593382:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593385:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862636.593387:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593390:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593394:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6516880900) 00010000:00010000:1.0:1787862636.593396:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862636.593397:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593400:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893093d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593412:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593415:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593419:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593422:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862636.593437:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593443:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593448:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6516880c00) 00010000:00010000:1.0:1787862636.593449:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862636.593451:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.593455:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862636.593556:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+25:11515:x1874709516994944:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 1306us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862636.593563:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 188 00000100:00100000:0.0:1787862636.656835:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.657000:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516995200 00000100:00100000:2.0:1787862636.657019:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516995200 00000100:00100000:2.0:1787862636.657130:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 189 00000100:00100000:2.0:1787862636.657145:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+25:11518:x1874709516995200:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862636.657190:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862636.657222:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf893094b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3496c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657329:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657350:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657365:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657384:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657392:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657399:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657863:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657873:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.657881:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862636.657895:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787862636.658093:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658103:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658111:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658119:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862636.658125:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658135:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658152:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862636.658157:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862636.658164:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658172:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919a00/0x9c5536ccf8930952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658186:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658193:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658199:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658205:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862636.658215:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658223:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658232:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6507fe6c00) 00010000:00010000:2.0:1787862636.658235:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862636.658238:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658245:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918000/0x9c5536ccf8930959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658304:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf893094b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658320:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.658329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862636.658332:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862636.658334:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918600, rc 0) 00000100:00100000:2.0:1787862636.658439:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+27:11518:x1874709516995200:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1297us (1611us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787862636.658450:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 189 00000100:00100000:2.0:1787862636.668320:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862636.672296:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516995328 00000100:00100000:0.0:1787862636.672322:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516995328 00000100:00100000:0.0:1787862636.672414:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 190 00000100:00100000:0.0:1787862636.672428:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+27:11518:x1874709516995328:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:0.0:1787862636.672542:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.672565:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.672582:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.672619:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.675171:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.675199:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.675208:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862636.675215:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.675227:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.675254:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:0.0:1787862636.675258:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862636.675264:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.675273:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf893096e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862636.675448:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+27:11518:x1874709516995328:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 3014us (7135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862636.675462:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 190 00000100:00100000:2.0:1787862636.677964:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862636.678119:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516995584 00000100:00100000:3.0:1787862636.678143:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516995584 00000100:00100000:3.0:1787862636.678220:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:3.0:1787862636.678233:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+27:11518:x1874709516995584:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862636.678820:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+28:11518:x1874709516995584:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 587us (872us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787862636.678838:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:2.0:1787862636.732919:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862636.739176:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516995840 00000100:00100000:3.0:1787862636.739199:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516995840 00000100:00100000:3.0:1787862636.739284:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:3.0:1787862636.739298:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+28:11044:x1874709516995840:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862636.739339:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862636.739370:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930975 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34973 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862636.739515:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862636.739532:0:12008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 29 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862636.739543:0:12008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862636.739588:0:12008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 29 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862636.739604:0:12008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 29 pid: 5817 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862636.739622:0:12008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8f840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526431232:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862636.739750:0:12008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6508193180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862636.767307:0:12008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8f840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526431232:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862636.767352:0:12008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862636.770553:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862636.770955:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516995968 00000100:00100000:3.0:1787862636.770988:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516995968 00010000:00010000:2.0:1787862636.771353:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 30 pid: 5817 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862636.771454:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 75 00000100:00100000:2.0:1787862636.771468:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+30:2349:x1874709516995968:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862636.771491:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862636.771499:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 30 pid: 5817 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.771516:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 30 pid: 5817 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.771548:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3496c expref: 30 pid: 5817 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.771565:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862636.771572:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.771584:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.771593:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.771640:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862636.771824:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:2349:x1874709516995968:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 357us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862636.771833:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 75 00010000:00010000:0.0:1787862636.771980:0:12008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.771988:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862636.772027:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787862636.772274:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930975 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 30 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.772308:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 29 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.772318:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:0.0:1787862636.772321:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862636.772324:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c000, rc 0) 00000100:00100000:0.0:1787862636.772361:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+29:11044:x1874709516995840:12345-192.168.202.60@tcp:101:bash.0 Request processed in 33067us (39465us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787862636.772370:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:0.0:1787862636.776222:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.776381:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516996224 00000100:00100000:2.0:1787862636.776412:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516996224 00000100:00100000:2.0:1787862636.776593:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00100000:2.0:1787862636.776606:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+29:11044:x1874709516996224:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:2.0:1787862636.777026:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.777076:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.777092:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862636.777162:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787862636.777192:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002df2155 reply state 00000000a9efeb73 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862636.777204:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787862636.777260:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787862636.777412:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+33:11044:x1874709516996224:12345-192.168.202.60@tcp:36:bash.0 Request processed in 806us (1206us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787862636.777421:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 192 00000020:00080000:2.0:1787862636.777428:0:5817:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787862636.785322:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.785349:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.785358:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.785365:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862636.785393:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.785403:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.785427:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862636.785431:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862636.785438:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.785445:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf893098a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862636.785856:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862636.785942:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516996352 00000100:00100000:1.0:1787862636.785958:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516996352 00000100:00100000:1.0:1787862636.786100:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:1.0:1787862636.786116:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+32:11044:x1874709516996352:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862636.786332:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862636.786359:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3497a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.786449:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3497a expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.786480:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3497a expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.786508:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787862636.786511:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862636.786514:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78e00, rc 0) 00000100:00100000:1.0:1787862636.786638:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+33:11044:x1874709516996352:12345-192.168.202.60@tcp:101:bash.0 Request processed in 526us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862636.786646:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:3.0:1787862636.798182:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862636.798330:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516996480 00000100:00100000:0.0:1787862636.798345:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516996480 00000100:00100000:0.0:1787862636.798473:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1787862636.798493:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6540398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:11044:x1874709516996480:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862636.798530:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862636.798560:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34981 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862636.798599:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a909e67, atime: 0x6a909e65, ctime: 0x6a909e67, blocks: 0xb 00010000:00010000:0.0:1787862636.798633:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1787862636.798639:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862636.798649:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.798709:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.798728:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031800, rc 0) 00000100:00100000:0.0:1787862636.798988:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6540398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:11044:x1874709516996480:12345-192.168.202.60@tcp:101:bash.0 Request processed in 353us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862636.799006:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00080000:1.0:1787862636.799258:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862636.807274:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.807429:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516996608 00000100:00100000:2.0:1787862636.807444:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516996608 00002000:00010000:2.0:1787862636.807515:0:6676:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787862636.807522:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6537f5de00 with x1874709516996608 ext(0->18446744073709551615) 00002000:00010000:2.0:1787862636.807540:0:6676:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6537f5de00. 00000100:00100000:2.0:1787862636.807582:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1787862636.807595:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709516996608:12345-192.168.202.60@tcp:10:bash.0 00002000:00010000:3.0:1787862636.808220:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787862636.808226:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787862631 -> 1787862636 00002000:00010000:3.0:1787862636.808230:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787862629 -> 1787862629 00002000:00010000:3.0:1787862636.808233:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787862631 -> 1787862636 00002000:00010000:3.0:1787862636.808235:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787862636.808318:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709516996608:12345-192.168.202.60@tcp:10:bash.0 Request processed in 723us (1058us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787862636.808328:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00002000:00010000:3.0:1787862636.808333:0:6676:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787862636.808336:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6537f5de00 with x1874709516996608 ext(0->18446744073709551615) 00002000:00010000:3.0:1787862636.808341:0:6676:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6537f5de00. 00000100:00100000:3.0:1787862636.886388:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862636.886529:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516996736 00000100:00100000:1.0:1787862636.886543:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516996736 00000100:00100000:1.0:1787862636.886629:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 194 00000100:00100000:1.0:1787862636.886641:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+33:11532:x1874709516996736:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:1.0:1787862636.886961:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.886986:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.887012:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.887034:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.887096:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.887133:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888395:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888421:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888527:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862636.888602:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888618:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888625:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888632:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888639:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862636.888644:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.888652:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889085:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862636.889103:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862636.889111:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889120:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf893099f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889220:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889229:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889236:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889241:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862636.889245:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889252:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889262:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6516880c00) 00010000:00010000:1.0:1787862636.889266:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862636.889270:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889276:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf89309a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889297:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889311:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889317:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889323:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862636.889326:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889332:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889340:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:1.0:1787862636.889343:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862636.889346:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862636.889352:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf89309ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862636.889574:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+33:11532:x1874709516996736:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 2927us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862636.889588:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 194 00000100:00100000:0.0:1787862636.932405:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.932524:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516996992 00000100:00100000:2.0:1787862636.932538:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516996992 00000100:00100000:2.0:1787862636.932619:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 195 00000100:00100000:2.0:1787862636.932631:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+33:11535:x1874709516996992:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862636.932659:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862636.932920:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34988 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933095:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933114:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933128:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933146:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933153:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933160:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933530:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89309c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933540:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89309c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.933547:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89309c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862636.933560:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787862636.934153:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934165:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934183:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934190:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862636.934195:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934204:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934219:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862636.934222:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862636.934227:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934234:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf89309bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934248:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934253:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934259:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934265:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862636.934268:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934282:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934290:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6507fe6c00) 00010000:00010000:2.0:1787862636.934292:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862636.934294:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934300:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89309c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934360:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34988 expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934374:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89309c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34988 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.934380:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862636.934382:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787862636.934384:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:2.0:1787862636.934486:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+35:11535:x1874709516996992:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1856us (2095us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787862636.934497:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 195 00000100:00100000:0.0:1787862636.939737:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.939851:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516997120 00000100:00100000:2.0:1787862636.939868:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516997120 00000100:00100000:2.0:1787862636.939963:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 196 00000100:00100000:2.0:1787862636.939979:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+35:11535:x1874709516997120:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:2.0:1787862636.940173:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.940195:0:7147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 35 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.940206:0:7147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.940251:0:7147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 35 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.940268:0:7147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 35 pid: 12008 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862636.940285:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526431360:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862636.940413:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862636.944526:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.944690:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7147:1874709526431360:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862636.944733:0:7147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862636.945591:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516997376 00000100:00100000:0.0:1787862636.945605:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516997376 00000100:00100000:0.0:1787862636.945684:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:0.0:1787862636.946122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+36:9943:x1874709516997376:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787862636.946554:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+37:9943:x1874709516997376:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 441us (2045us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787862636.946562:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:0.0:1787862636.950020:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862636.950606:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516997504 00000100:00100000:2.0:1787862636.950623:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516997504 00010000:00010000:2.0:1787862636.951009:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 37 pid: 12008 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862636.951166:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:2.0:1787862636.951181:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+37:2349:x1874709516997504:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862636.951225:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862636.951234:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 37 pid: 12008 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.951252:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 37 pid: 12008 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.951280:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf893097c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34973 expref: 37 pid: 12008 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.951301:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:2.0:1787862636.951307:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.951320:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.951328:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862636.951425:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862636.951515:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+36:2349:x1874709516997504:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 338us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862636.951526:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 76 00010000:00010000:0.0:1787862636.953336:0:7147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953356:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953407:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953513:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953522:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953529:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862636.953535:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953544:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953566:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:0.0:1787862636.953569:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862636.953575:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862636.953582:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89309d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862636.954149:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+35:11535:x1874709516997120:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 14165us (14419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862636.954164:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 196 00000100:00100000:1.0:1787862636.963940:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862636.964021:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516997760 00000100:00100000:1.0:1787862636.964037:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516997760 00000100:00100000:1.0:1787862636.964138:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:1.0:1787862636.964151:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64018630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+35:11535:x1874709516997760:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862636.964535:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64018630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+36:11535:x1874709516997760:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 384us (608us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787862636.964544:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:1.0:1787862637.085486:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.085607:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516998016 00000100:00100000:0.0:1787862637.085621:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516998016 00000100:00100000:0.0:1787862637.085731:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:0.0:1787862637.085746:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401860b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+36:11546:x1874709516998016:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:0.0:1787862637.085781:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862637.085830:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf89309de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3498f expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.085948:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.085966:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.085980:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086012:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086020:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086027:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086512:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89309f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086525:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89309f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086533:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89309f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862637.086546:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787862637.086678:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086699:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086707:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086714:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862637.086720:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086731:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086749:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862637.086753:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862637.086761:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086770:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf89309e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086787:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086793:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086799:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086805:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862637.086815:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086822:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086830:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517dfc400) 00010000:00010000:0.0:1787862637.086833:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862637.086836:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086842:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf89309ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086897:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf89309de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3498f expref: 39 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086912:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89309f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3498f expref: 38 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.086919:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:0.0:1787862637.086922:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862637.086924:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787862637.087035:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401860b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+38:11546:x1874709516998016:12345-192.168.202.60@tcp:101:cat.0 Request processed in 1292us (1566us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787862637.087110:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:1.0:1787862637.102471:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862637.103355:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516998272 00000100:00100000:3.0:1787862637.103373:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516998272 00000100:00100000:3.0:1787862637.103573:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:3.0:1787862637.103588:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401863840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+38:11546:x1874709516998272:12345-192.168.202.60@tcp:35:cat.0 00000100:00100000:3.0:1787862637.104229:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401863840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+39:11546:x1874709516998272:12345-192.168.202.60@tcp:35:cat.0 Request processed in 642us (1771us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787862637.104240:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:2.0:1787862637.123397:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862637.123572:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516998528 00000100:00100000:3.0:1787862637.123586:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516998528 00000100:00100000:3.0:1787862637.123668:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 198 00000100:00100000:3.0:1787862637.123897:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+39:11547:x1874709516998528:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:3.0:1787862637.124005:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787862637.124124:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf89309f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3498f expref: 39 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124154:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89309c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34988 expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124170:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3497a expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124183:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6507fe6200) 00010000:00010000:3.0:1787862637.124198:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862637.124230:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124247:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124260:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124276:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124283:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124290:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124961:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.124986:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.125003:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862637.127528:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787862637.127552:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362891508693ns, next at 363891502722ns, rc = 0 00010000:00010000:2.0:1787862637.127654:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127713:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127728:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127739:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127746:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127755:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127788:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862637.127821:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127827:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127834:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127840:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862637.127846:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127854:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127881:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:2.0:1787862637.127884:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787862637.127890:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127897:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930a0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127922:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127929:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127934:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127940:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862637.127942:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127948:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127956:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862637.127959:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862637.127962:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.127968:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930a01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862637.128002:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038f49ee4 reply state 00000000f362e3b2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862637.128014:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862637.128198:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+38:11547:x1874709516998528:12345-192.168.202.60@tcp:36:rm.0 Request processed in 4300us (4810us total) trans 4294967481 rc 0/0 00010000:00010000:1.0:1787862637.128275:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862637.128285:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.128293:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862637.128297:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.128304:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.128316:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6517c53200) 00010000:00010000:1.0:1787862637.128318:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862637.128322:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.128328:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930a16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.128353:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862637.128355:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862637.128357:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862637.145168:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 198 00010000:00010000:1.0:1787862637.145339:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.145352:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.145382:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.145387:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862637.145391:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.145398:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.145417:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517c53300) 00010000:00010000:1.0:1787862637.145420:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862637.145537:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.145543:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930a08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.148290:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862637.182471:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.182622:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516998784 00000100:00100000:1.0:1787862637.182636:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516998784 00000100:00100000:1.0:1787862637.182730:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 199 00000100:00100000:1.0:1787862637.182743:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+37:11553:x1874709516998784:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862637.182783:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862637.182817:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf8930a1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34996 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.183018:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.183113:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.183129:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.183152:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.183159:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.183166:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862637.183915:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787862637.184239:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184257:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184271:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184320:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184328:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184336:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184353:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862637.184359:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184369:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184387:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862637.184392:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862637.184400:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184408:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862637.184425:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003304f764 reply state 000000003c6a0d79 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.184437:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787862637.184481:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf8930a1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184497:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.184504:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862637.184506:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862637.184509:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78a00, rc 0) 00000100:00100000:1.0:1787862637.184630:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+40:11553:x1874709516998784:12345-192.168.202.60@tcp:101:bash.0 Request processed in 1889us (2177us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787862637.184647:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 199 00010000:00010000:0.0:1787862637.188464:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.188485:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.188512:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.188519:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862637.188525:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.188534:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.188556:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6516880c00) 00010000:00010000:0.0:1787862637.188559:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862637.188564:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.188572:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78e00/0x9c5536ccf8930a2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862637.190005:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.190208:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516998912 00000100:00100000:0.0:1787862637.190222:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516998912 00000100:00100000:0.0:1787862637.190315:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:0.0:1787862637.190329:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+5:2348:x1874709516998912:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862637.190356:0:12006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862637.190383:0:12006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b3499d expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862637.190418:0:12006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862637.190455:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1787862637.190475:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862637.190486:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 6 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.190510:0:12006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 6 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.190528:0:12006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031a00, rc 0) 00000100:00100000:0.0:1787862637.190605:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516998912:12345-192.168.202.60@tcp:101:bash.0 Request processed in 281us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862637.190613:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00080000:1.0:1787862637.190834:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862637.194532:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.194634:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516999040 00000100:00100000:0.0:1787862637.194648:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516999040 00000100:00100000:0.0:1787862637.194759:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:0.0:1787862637.194772:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+6:11553:x1874709516999040:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862637.194800:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862637.194826:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349a4 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.194870:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 7 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.194880:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862637.194886:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862637.194892:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.194961:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 7 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.194978:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 7 pid: 12006 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862637.195007:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1874709526431488:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862637.195178:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640197fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862637.198996:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.199127:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516999168 00000100:00100000:1.0:1787862637.199142:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516999168 00010000:00010000:1.0:1787862637.199197:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 8 pid: 12006 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.199252:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:1.0:1787862637.199264:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6512570450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709516999168:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862637.199287:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862637.199320:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 8 pid: 12006 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.199336:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 8 pid: 12006 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.199370:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862637.199375:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862637.199385:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.199395:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.199442:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.199476:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64018603c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1874709526431616:192.168.202.60@tcp:105: 00000100:00100000:1.0:1787862637.199589:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd99c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787862637.199933:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a9928c1/0x9c5536ccf8930a40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b3499d expref: 8 pid: 12006 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862637.199954:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1874709526431488:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862637.200000:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.200012:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030c00, rc 0) 00000100:00100000:3.0:1787862637.200120:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:11553:x1874709516999040:12345-192.168.202.60@tcp:101:bash.0 Request processed in 5351us (5605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862637.200129:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:3.0:1787862637.208292:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.208452:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516999424 00000100:00100000:0.0:1787862637.208468:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516999424 00000100:00100000:0.0:1787862637.208561:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:0.0:1787862637.208575:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+39:11553:x1874709516999424:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:0.0:1787862637.209540:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+40:11553:x1874709516999424:12345-192.168.202.60@tcp:35:bash.0 Request processed in 960us (1260us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787862637.209557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:1.0:1787862637.210518:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64018603c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1874709526431616:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787862637.210549:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862637.210598:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6512570450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709516999168:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 11336us (11627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862637.210611:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:0.0:1787862637.427477:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.427612:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516999552 00000100:00100000:1.0:1787862637.427624:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516999552 00000100:00100000:1.0:1787862637.427726:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 200 00000100:00100000:1.0:1787862637.427739:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+40:11569:x1874709516999552:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862637.427774:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862637.427801:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf8930a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349ab expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.427889:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.427908:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.427925:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862637.428033:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787862637.428037:0:12008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862637.428117:0:12008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.428153:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79600/0x9c5536ccf8930a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ab expref: 42 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.428179:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ab expref: 41 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.428189:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862637.428193:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862637.428198:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79a00, rc 0) 00000100:00100000:1.0:1787862637.428297:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+41:11569:x1874709516999552:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 560us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862637.428305:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 200 00000100:00100000:3.0:1787862637.432590:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.432899:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709516999808 00000100:00100000:0.0:1787862637.432913:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709516999808 00000100:00100000:0.0:1787862637.433018:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 201 00000100:00100000:0.0:1787862637.433032:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+41:11569:x1874709516999808:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862637.433097:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862637.433127:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930a5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349b2 expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.433302:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.433320:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.433335:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862637.433350:0:12007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787862637.433609:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930a5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b2 expref: 44 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.433634:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b2 expref: 43 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.433644:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:0.0:1787862637.433648:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862637.433652:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031c00, rc 0) 00000100:00100000:0.0:1787862637.434231:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+43:11569:x1874709516999808:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1199us (1655us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787862637.434242:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 201 00000100:00100000:3.0:1787862637.441465:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862637.441518:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862637.442116:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000192 00000100:00100000:2.0:1787862637.442141:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000192 00000100:00100000:2.0:1787862637.442244:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787862637.442258:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+43:2349:x1874709517000192:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862637.442280:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862637.442316:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b2 expref: 43 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.442342:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:2.0:1787862637.442349:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862637.442420:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+42:2349:x1874709517000192:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 164us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862637.442429:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862637.443951:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000064 00000100:00100000:1.0:1787862637.443972:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000064 00000100:00100000:1.0:1787862637.444071:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 202 00000100:00100000:1.0:1787862637.444082:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+42:11569:x1874709517000064:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862637.444119:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862637.444147:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349b9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.444285:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930a78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.444304:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.444318:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862637.444353:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787862637.444540:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b9 expref: 45 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.444563:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b9 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.444575:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:1.0:1787862637.444578:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787862637.444582:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79e00, rc 0) 00000100:00100000:1.0:1787862637.444656:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+44:11569:x1874709517000064:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 576us (3207us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787862637.444665:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 202 00000100:00100000:1.0:1787862637.456272:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862637.456946:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000320 00000100:00100000:2.0:1787862637.456964:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000320 00000100:00100000:2.0:1787862637.457090:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:2.0:1787862637.457105:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401861e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2346:x1874709517000320:12345-192.168.202.60@tcp:1:lfs.0 00010000:00010000:2.0:1787862637.457212:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.457241:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.457252:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787862637.457257:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862637.457262:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.457312:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.457329:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 6 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862637.457348:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11687:1874709526431744:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862637.457494:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787862637.467219:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11687:1874709526431744:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862637.467265:0:11687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.468177:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862637.471933:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000448 00000100:00100000:2.0:1787862637.471957:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000448 00002000:00100000:2.0:1787862637.472104:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a6401860780 x1874709517000448/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:753/0 lens 504/0 e 0 to 0 dl 1787862648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862637.472153:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6401860780 with x1874709517000448 ext(0->8) 00010000:00010000:2.0:1787862637.472168:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 7 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.472189:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 7 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862637.472198:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a6401860780 00000100:00100000:2.0:1787862637.472248:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1787862637.472261:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401860780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709517000448:12345-192.168.202.60@tcp:4:lfs.0 00000100:00100000:2.0:1787862637.473001:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401860780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:2348:x1874709517000448:12345-192.168.202.60@tcp:4:lfs.0 Request processed in 726us (4814us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787862637.473014:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00002000:00100000:2.0:1787862637.473023:0:6677:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a6401860780 x1874709517000448/t4294967308(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:753/0 lens 504/448 e 0 to 0 dl 1787862648 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787862637.473032:0:6677:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6401860780 with x1874709517000448 ext(0->8) 00010000:00010000:2.0:1787862637.473090:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 9 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.473109:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 9 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862637.473117:0:6677:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a6401860780 00000100:00100000:0.0:1787862637.484764:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862637.485078:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000576 00000100:00100000:2.0:1787862637.485115:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000576 00010000:00010000:2.0:1787862637.485183:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 9 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862637.485232:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:2.0:1787862637.485244:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:2347:x1874709517000576:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862637.485265:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787862637.485290:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787862637.485293:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787862637 00002000:00010000:2.0:1787862637.485296:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787862637 00002000:00010000:2.0:1787862637.485298:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787862637 00010000:00010000:2.0:1787862637.485306:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 9 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.485322:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 9 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.485625:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008883b2b9/0x9c5536ccf8930a47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349a4 expref: 9 pid: 6670 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.485652:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862637.485657:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862637.485677:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.485816:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.485942:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862637.486036:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709517000576:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 792us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862637.486088:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00010000:00010000:1.0:1787862637.487975:0:11687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488010:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488222:0:11687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488233:0:11687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488272:0:11687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488281:0:11687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862637.488287:0:11687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488298:0:11687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488324:0:11687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.488333:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930a86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.488692:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401861e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2346:x1874709517000320:12345-192.168.202.60@tcp:1:lfs.0 Request processed in 31578us (32425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862637.488705:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:2.0:1787862637.497296:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.497412:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000832 00000100:00100000:1.0:1787862637.497443:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000832 00000100:00100000:1.0:1787862637.497539:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:1.0:1787862637.497554:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+44:11569:x1874709517000832:12345-192.168.202.60@tcp:35:lfs.0 00000004:00010000:1.0:1787862637.497657:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b9 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862637.498343:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787862637.498401:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787862637.500556:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787862637.501018:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.501076:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 48 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.501089:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.501323:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 48 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.501345:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 48 pid: 5815 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.501515:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64018603c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874709526431872:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862637.501717:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862637.510249:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.511099:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64018603c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874709526431872:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862637.511155:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862637.511687:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517000960 00000100:00100000:2.0:1787862637.511698:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517000960 00010000:00010000:2.0:1787862637.511763:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 49 pid: 5815 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862637.511885:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:2.0:1787862637.511897:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+49:2349:x1874709517000960:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862637.511922:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862637.511931:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 49 pid: 5815 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.511948:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 49 pid: 5815 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.511979:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78a00/0x9c5536ccf8930a32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34996 expref: 49 pid: 5815 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.512015:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:2.0:1787862637.512021:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.512116:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.512125:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.512178:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862637.512261:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+48:2349:x1874709517000960:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 365us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862637.512270:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 79 00010000:00010000:0.0:1787862637.512340:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.512348:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862637.512570:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787862637.512843:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787862637.513004:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f895680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526432000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862637.513128:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862637.513182:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432000 00000100:00100000:0.0:1787862637.513189:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432000 00000100:00100000:0.0:1787862637.513250:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862637.513259:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874709526432000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862637.513345:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874709526432000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862637.513353:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787862637.513376:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862637.513391:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65081d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862637.513427:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f895680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526432000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787862637.513971:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787862637.514095:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526432128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862637.514139:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862637.514181:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432128 00000100:00100000:0.0:1787862637.514186:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432128 00000100:00100000:0.0:1787862637.514215:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862637.514223:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874709526432128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787862637.514415:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5818:x1874709526432128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 192us (275us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787862637.514423:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862637.514445:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65081d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862637.514478:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e86580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874709526432128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787862637.514531:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787862637.514572:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.514585:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.514593:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.514600:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862637.514606:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.514615:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.514635:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:0.0:1787862637.514638:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787862637.514645:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.514652:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79400/0x9c5536ccf8930a8d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787862637.514861:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787862637.515018:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787862637.515035:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363278991996ns, next at 364278989358ns, rc = 0 00000001:00080000:0.0:1787862637.515081:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787862637.515120:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6516880900) 00010000:00010000:0.0:1787862637.515130:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787862637.515139:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930a78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349b9 expref: 52 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862637.515263:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+51:11569:x1874709517000832:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 17712us (17984us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787862637.515274:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000020:00080000:0.0:1787862637.515279:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787862637.521023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.522344:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517001088 00000100:00100000:0.0:1787862637.522383:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517001088 00000100:00100000:0.0:1787862637.522514:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00100000:0.0:1787862637.522531:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64018603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+51:11569:x1874709517001088:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862637.522575:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862637.522612:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349c0 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.523318:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349c0 expref: 52 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.523344:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349c0 expref: 52 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.523505:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862637.523510:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862637.523515:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030c00, rc 0) 00000100:00100000:0.0:1787862637.523611:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64018603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+52:11569:x1874709517001088:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1084us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862637.523621:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00100000:1.0:1787862637.530233:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862637.530399:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517001344 00000100:00100000:3.0:1787862637.530414:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517001344 00000100:00100000:3.0:1787862637.530501:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:3.0:1787862637.530513:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401861680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+52:11569:x1874709517001344:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787862637.533673:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401861680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+53:11569:x1874709517001344:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 3132us (3431us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787862637.535093:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:1.0:1787862637.648198:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862637.648348:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517001472 00000100:00100000:3.0:1787862637.648369:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517001472 00000100:00100000:3.0:1787862637.648436:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 204 00000100:00100000:3.0:1787862637.648445:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64018612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+53:11579:x1874709517001472:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:3.0:1787862637.648543:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648563:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648574:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648590:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648595:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648599:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648750:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648759:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.648766:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787862637.649104:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649129:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649134:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649140:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649144:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422cc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862637.649148:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649154:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649167:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:3.0:1787862637.649169:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862637.649174:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649179:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930a9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649190:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649193:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649197:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649205:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862637.649207:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649210:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649214:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517c53700) 00010000:00010000:3.0:1787862637.649216:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862637.649218:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649221:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649232:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649235:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649239:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649241:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862637.649243:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649246:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649258:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862637.649259:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862637.649261:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862637.649266:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862637.649363:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64018612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+53:11579:x1874709517001472:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 917us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862637.649373:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 204 00000100:00100000:1.0:1787862637.702833:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862637.703095:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517001728 00000100:00100000:2.0:1787862637.703108:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517001728 00000100:00100000:2.0:1787862637.703188:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 205 00000100:00100000:2.0:1787862637.703206:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401862940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+53:11582:x1874709517001728:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862637.703241:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862637.703274:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349c7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703355:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703719:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703738:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703770:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703779:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703786:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703932:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703941:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.703949:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862637.704141:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787862637.704592:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704601:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704609:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704615:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862637.704619:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704638:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704653:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862637.704657:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862637.704662:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704669:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704685:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704691:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704697:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704703:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862637.704706:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704713:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704720:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6507fe6c00) 00010000:00010000:2.0:1787862637.704723:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862637.704726:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704742:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704795:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349c7 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704817:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349c7 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862637.704823:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862637.704826:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862637.704828:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc000, rc 0) 00000100:00100000:2.0:1787862637.705095:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401862940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+55:11582:x1874709517001728:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1896us (2271us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787862637.705106:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 205 00000100:00100000:1.0:1787862637.726615:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.726717:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517001856 00000100:00100000:0.0:1787862637.726729:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517001856 00000100:00100000:0.0:1787862637.726797:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 206 00000100:00100000:0.0:1787862637.726810:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+55:11582:x1874709517001856:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:0.0:1787862637.726896:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.726915:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.726928:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.727104:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.727113:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.727120:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.727125:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500031c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862637.727129:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.727136:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.727150:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862637.727153:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862637.727158:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.733479:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862637.733614:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+55:11582:x1874709517001856:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 6800us (7002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862637.733626:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 206 00000100:00100000:1.0:1787862637.742723:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.743464:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517002112 00000100:00100000:0.0:1787862637.743477:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517002112 00000100:00100000:0.0:1787862637.743538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:0.0:1787862637.743549:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401862d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+55:11582:x1874709517002112:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862637.743806:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401862d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+56:11582:x1874709517002112:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 258us (1092us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787862637.743815:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:1.0:1787862637.778390:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.778438:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.778471:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.778498:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517002368 00000100:00100000:1.0:1787862637.778507:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517002368 00000100:00100000:1.0:1787862637.778563:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787862637.778575:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401862580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:2347:x1874709517002368:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862637.778651:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401862580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+9:2347:x1874709517002368:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862637.778659:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787862637.778790:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517002496 00000100:00100000:1.0:1787862637.778795:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517002496 00000100:00100000:1.0:1787862637.778844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 179 00000100:00100000:1.0:1787862637.778851:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401863c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709517002496:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862637.778884:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401863c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709517002496:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862637.778892:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 179 00000100:00080000:0.0:1787862637.779410:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862637.779559:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517002240 00000100:00100000:3.0:1787862637.779565:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517002240 00000100:00100000:3.0:1787862637.779598:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 308 00000100:00100000:3.0:1787862637.779606:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709517002240:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862637.779659:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709517002240:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 53us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862637.779666:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 308 00000001:00080000:1.0:1787862637.828618:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787862637.828646:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787862637.924127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.924225:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517002752 00000100:00100000:0.0:1787862637.924239:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517002752 00000100:00100000:0.0:1787862637.924310:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:0.0:1787862637.924321:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64018621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+56:11592:x1874709517002752:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862637.924350:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862637.924353:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787862637.924390:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79a00/0x9c5536ccf8930a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ab expref: 56 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.924410:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862637.924415:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862637.924430:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ada lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349ce expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.924552:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.924566:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.924576:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862637.924586:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787862637.924734:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930ada lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ce expref: 58 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.924751:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ce expref: 57 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.924759:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862637.924762:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862637.924765:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500031a00, rc 0) 00000100:00100000:0.0:1787862637.924839:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64018621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+57:11592:x1874709517002752:12345-192.168.202.60@tcp:101:bash.0 Request processed in 520us (723us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787862637.924846:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:0.0:1787862637.932540:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862637.932664:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517003008 00000100:00100000:1.0:1787862637.932675:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517003008 00000100:00100000:1.0:1787862637.932747:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 208 00000100:00100000:1.0:1787862637.932757:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+57:11592:x1874709517003008:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:1.0:1787862637.932853:0:12008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787862637.932883:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ce expref: 57 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.932905:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349c7 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.932915:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:1.0:1787862637.932921:0:12008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862637.933453:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.933471:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.933482:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862637.933541:0:12008:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787862637.933567:0:12008:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001aa5bc09 reply state 00000000e3f529b1 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.933574:0:12008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862637.933723:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+58:11592:x1874709517003008:12345-192.168.202.60@tcp:36:bash.0 Request processed in 965us (1196us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787862637.933731:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 208 00000020:00080000:1.0:1787862637.933737:0:12008:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787862637.944477:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:0.0:1787862637.944753:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.944766:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.944792:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.944798:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862637.944803:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.944823:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.944840:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862637.944844:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862637.944849:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862637.944855:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78600/0x9c5536ccf8930aef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862637.956126:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517003136 00000100:00100000:1.0:1787862637.956146:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517003136 00000100:00100000:1.0:1787862637.956229:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 209 00000100:00100000:1.0:1787862637.956256:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+57:11592:x1874709517003136:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862637.956915:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862637.956938:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79000/0x9c5536ccf8930af6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349d5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.957040:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.957090:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.957102:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862637.957131:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787862637.957137:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862637.957157:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.957185:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79000/0x9c5536ccf8930af6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.957598:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862637.957608:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:1.0:1787862637.957611:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862637.957614:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78000, rc 0) 00000100:00100000:1.0:1787862637.957804:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+58:11592:x1874709517003136:12345-192.168.202.60@tcp:101:bash.0 Request processed in 1550us (13337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862637.959257:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 209 00000100:00100000:1.0:1787862637.963753:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862637.964470:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517003392 00000100:00100000:0.0:1787862637.964482:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517003392 00000100:00100000:0.0:1787862637.964594:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:0.0:1787862637.964604:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64018630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+58:11592:x1874709517003392:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:0.0:1787862637.964872:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64018630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+59:11592:x1874709517003392:12345-192.168.202.60@tcp:35:bash.0 Request processed in 269us (1259us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787862637.964881:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1787862638.128968:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862638.129234:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517003520 00000100:00100000:0.0:1787862638.129248:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517003520 00000100:00100000:0.0:1787862638.129369:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 210 00000100:00100000:0.0:1787862638.129383:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+59:11598:x1874709517003520:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862638.129456:0:7147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862638.129491:0:7147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349dc expref: -99 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.129588:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.129609:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.129626:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862638.129888:0:7147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787862638.129894:0:7147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862638.129929:0:7147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.129964:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031c00/0x9c5536ccf8930b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349dc expref: 61 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.130001:0:7147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349dc expref: 60 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.130013:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862638.130016:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862638.130021:0:7147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6500030200, rc 0) 00000100:00100000:0.0:1787862638.130186:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517003520:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 805us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862638.130196:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 210 00000100:00080000:2.0:1787862638.130591:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862638.133649:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862638.133958:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517003648 00000100:00100000:0.0:1787862638.133973:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517003648 00000100:00100000:0.0:1787862638.134105:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:0.0:1787862638.134121:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517003648:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862638.134156:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862638.134190:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930b12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349e3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134322:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134345:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134362:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134384:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134392:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134398:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134551:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134561:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134580:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862638.134635:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787862638.134642:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862638.134668:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134972:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.134996:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135003:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135010:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135017:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862638.135022:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135031:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135085:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862638.135090:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862638.135098:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135117:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135134:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135140:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135146:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135151:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862638.135155:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135161:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135170:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6517dfc400) 00010000:00010000:0.0:1787862638.135172:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862638.135175:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135181:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135225:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500031a00/0x9c5536ccf8930b12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349e3 expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135244:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349e3 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.135259:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862638.135262:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862638.135265:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637000, rc 0) 00000100:00100000:0.0:1787862638.135358:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+61:11598:x1874709517003648:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1242us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862638.135368:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 211 00000100:00100000:1.0:1787862638.142346:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862638.142414:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862638.142506:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517003776 00000100:00100000:3.0:1787862638.142520:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517003776 00000100:00100000:3.0:1787862638.142617:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787862638.142630:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401863840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+61:2348:x1874709517003776:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862638.142651:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862638.143765:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8930b27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349e3 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.143796:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862638.143803:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862638.143897:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401863840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+60:2348:x1874709517003776:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 1269us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862638.143908:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:0.0:1787862638.148343:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004032 00000100:00100000:0.0:1787862638.148367:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004032 00000100:00100000:0.0:1787862638.149781:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 212 00000100:00100000:0.0:1787862638.149812:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401860f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517004032:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862638.149850:0:12007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862638.149883:0:12007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349ea expref: -99 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.150076:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.150096:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.150107:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.150154:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.150172:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 61 pid: 5817 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862638.150210:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526432256:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862638.150350:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6511593480 going to sleep for 11 seconds 00000100:00100000:1.0:1787862638.162254:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862638.162947:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526432256:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862638.162995:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862638.163217:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004160 00000100:00100000:3.0:1787862638.163227:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004160 00010000:00010000:3.0:1787862638.163279:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 62 pid: 5817 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862638.163329:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:3.0:1787862638.163340:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+62:2349:x1874709517004160:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862638.163358:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862638.163366:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 62 pid: 5817 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.163381:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 62 pid: 5817 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.163411:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349d5 expref: 62 pid: 5817 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.163445:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862638.163451:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.163482:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.163490:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.163527:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862638.163608:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+61:2349:x1874709517004160:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 269us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862638.163617:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 80 00010000:00010000:0.0:1787862638.163958:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.163969:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862638.164010:0:12007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787862638.164276:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 62 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.164298:0:12007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 61 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.164307:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862638.164309:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862638.164313:0:12007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637a00, rc 0) 00000100:00100000:0.0:1787862638.164350:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401860f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+61:11598:x1874709517004032:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 14556us (21935us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787862638.164359:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 212 00010000:00010000:0.0:1787862638.174240:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862638.174533:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862638.174799:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004416 00000100:00100000:2.0:1787862638.174814:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004416 00000100:00100000:2.0:1787862638.174899:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862638.174913:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+61:11598:x1874709517004416:12345-192.168.202.60@tcp:103:lfs.0 00010000:00010000:2.0:1787862638.174936:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862638.174967:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030c00/0x9c5536ccf8930a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349c0 expref: 61 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.175004:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862638.175010:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862638.175124:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517004416:12345-192.168.202.60@tcp:103:lfs.0 Request processed in 213us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.175132:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787862638.180813:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862638.180970:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004544 00000100:00100000:2.0:1787862638.180995:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004544 00000100:00100000:2.0:1787862638.181107:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:2.0:1787862638.181122:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517004544:12345-192.168.202.60@tcp:58:lfs.0 00010000:00010000:2.0:1787862638.181275:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.181299:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.181316:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862638.181601:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787862638.181725:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517004544:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 606us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.181734:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:1.0:1787862638.184238:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862638.184355:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004672 00000100:00100000:0.0:1787862638.184368:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004672 00000100:00100000:0.0:1787862638.184441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 214 00000100:00100000:0.0:1787862638.184453:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+60:11598:x1874709517004672:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862638.184480:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862638.184510:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349f1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.184589:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.184601:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.184625:0:5816:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.184640:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.184655:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862638.184658:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862638.184661:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.184670:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636000, rc 0) 00000100:00100000:0.0:1787862638.184772:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+61:11598:x1874709517004672:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 320us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862638.184780:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 214 00000100:00100000:3.0:1787862638.236533:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653464a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526432384:0@lo:400:kworker.0 00000100:00100000:1.0:1787862638.236583:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651c17d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526432640:0@lo:400:kworker.0 00000100:00100000:0.0:1787862638.236727:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526432768:0@lo:400:kworker.0 00000100:00100000:2.0:1787862638.236899:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526432512:0@lo:400:kworker.0 00000100:00100000:1.0:1787862638.241709:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862638.241863:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432640 00000100:00100000:1.0:1787862638.241874:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432640 00000100:00080000:1.0:1787862638.241917:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862638.241989:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787862638.242002:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526432640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862638.242100:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526432640:12345-0@lo:400:kworker.0 Request processed in 102us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862638.242109:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787862638.242163:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651c17d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526432640:0@lo:400:kworker.0 00000100:00100000:3.0:1787862638.244315:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862638.244914:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526432896:0@lo:400:kworker.0 00000100:00100000:3.0:1787862638.245008:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862638.245108:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432896 00000100:00100000:3.0:1787862638.245117:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432896 00000100:00100000:1.0:1787862638.245534:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432384 00000100:00100000:1.0:1787862638.245541:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432384 00000100:00100000:1.0:1787862638.245583:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787862638.245594:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526432384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862638.245662:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3282:x1874709526432384:12345-0@lo:400:kworker.0 Request processed in 70us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862638.245961:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787862638.248111:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787862638.248163:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526432896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862638.248308:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526432896:12345-0@lo:400:kworker.0 Request processed in 170us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862638.248317:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1787862638.248383:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862638.248478:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526432896:0@lo:400:kworker.0 00000100:00100000:3.0:1787862638.248497:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653464a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526432384:0@lo:400:kworker.0 00000100:00100000:0.0:1787862638.249465:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862638.249791:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432768 00000100:00100000:3.0:1787862638.249816:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432768 00000100:00100000:3.0:1787862638.249946:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787862638.249956:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526432768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862638.250067:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526432768:12345-0@lo:400:kworker.0 Request processed in 87us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862638.250075:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787862638.253426:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526432768:0@lo:400:kworker.0 00000100:00080000:1.0:1787862638.254679:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862638.255036:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862638.259424:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526432512 00000100:00100000:0.0:1787862638.259451:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526432512 00000100:00100000:0.0:1787862638.259543:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787862638.259559:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526432512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862638.259730:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526432512:12345-0@lo:400:kworker.0 Request processed in 175us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862638.259739:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787862638.259891:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526432512:0@lo:400:kworker.0 00000004:00080000:0.0:1787862638.748964:0:7989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364512917022ns, next at 365512912867ns, rc = 0 00000100:00100000:2.0:1787862638.749111:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862638.753100:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862638.755189:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526433024 00000100:00100000:2.0:1787862638.755214:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526433024 00000100:00100000:2.0:1787862638.755477:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862638.756004:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526433024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862638.756064:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787862638.756992:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526433024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1475us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.757007:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862638.759731:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787862638.759749:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a653dc8a580, transno 4294967307 00000004:00080000:2.0:1787862638.759779:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1787862638.759833:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526433024:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787862638.826988:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1787862638.827018:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1787862638.827031:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000004:00080000:3.0:1787862638.835394:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1787862638.835441:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:3.0:1787862638.835458:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787862638.835477:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a653e46c900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787862638.835483:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6509f1b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a653e46c0c0 00000020:00080000:3.0:1787862638.835487:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6509f1b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6537f8c800 00000020:00080000:3.0:1787862638.835527:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a65091449c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787862638.835531:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6509f1b000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6509897000 00000020:00080000:3.0:1787862638.835535:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6509f1b400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a650537f400 00000004:00080000:3.0:1787862638.835605:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1787862638.835817:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:1.0:1787862638.835947:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787862638.836208:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787862638.836448:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526433152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787862638.836550:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862638.836704:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526433152 00000100:00100000:1.0:1787862638.836715:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526433152 00000100:00100000:1.0:1787862638.836788:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787862638.836800:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526433152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787862638.836855:0:11687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787862638.836891:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.836920:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.836932:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787862638.836937:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862638.836943:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.836991:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.837008:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 6 pid: 6671 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862638.837082:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653dc8a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526433280:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862638.837164:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787862638.840584:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526433408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787862638.841002:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862638.841465:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526433408 00000100:00100000:2.0:1787862638.841478:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526433408 00000100:00100000:2.0:1787862638.841550:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787862638.841562:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526433408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787862638.841606:0:6671:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787862638.841655:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a909e6d, atime: 0x6a909e6d, ctime: 0x6a909e6d, blocks: 0xb 00010000:00010000:2.0:1787862638.841665:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.841900:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787862638.841906:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862638.841915:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.841937:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.841984:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.841994:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.842023:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787862638.843466:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653dc8a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526433280:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862638.843506:0:11687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862638.844371:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526433408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2805us (3364us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787862638.844386:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:2.0:1787862638.844429:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862638.844438:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.844448:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862638.844454:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.844466:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.844495:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.844503:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8930b58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.844568:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862638.844570:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862638.844572:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862638.844759:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000004:00080000:3.0:1787862638.845433:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a653460d680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787862638.845445:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526433408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787862638.845965:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004800 00000100:00100000:2.0:1787862638.845987:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004800 00010000:00010000:2.0:1787862638.846145:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 7 pid: 6671 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787862638.846246:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862638.846300:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:2.0:1787862638.846313:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6512570c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709517004800:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862638.846340:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862638.846347:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 7 pid: 6671 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.846361:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 7 pid: 6671 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.846393:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006762148d/0x9c5536ccf8930998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34981 expref: 7 pid: 6671 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.846426:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862638.846431:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862638.846438:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.846471:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.846514:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862638.846594:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6512570c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709517004800:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 283us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.846603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 81 00010000:00010000:1.0:1787862638.847155:0:11687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.847168:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.847180:0:11687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.847188:0:11687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.847217:0:11687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787862638.848581:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526433152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11775us (12023us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787862638.848607:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1787862638.848784:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862638.848798:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.848813:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862638.848827:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.848841:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.848864:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.848871:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930b51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862638.848909:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862638.848911:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862638.848913:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862638.849093:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1787862638.849101:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1787862638.849134:0:3283:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6402a8cf00 x1874709526433152/t4294967319(4294967319) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787862654 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787862638.849149:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6402a8cf00/2, rc 0, transno 4294967319 00000100:00100000:1.0:1787862638.849155:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526433152:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1787862638.942264:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787862638.942278:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862638.942334:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787862638.942346:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862638.942523:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526433536:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787862638.943173:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862638.948550:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526433536:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862638.951359:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862638.952540:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517004928 00000100:00100000:2.0:1787862638.952560:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517004928 00000100:00100000:2.0:1787862638.953060:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:2.0:1787862638.953076:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+19:11599:x1874709517004928:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862638.953123:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862638.953288:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+19:11599:x1874709517004928:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 216us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.953296:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 215 00000100:00100000:1.0:1787862638.959556:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862638.959941:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517005056 00000100:00100000:3.0:1787862638.959960:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517005056 00000100:00100000:3.0:1787862638.960117:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 216 00000100:00100000:3.0:1787862638.960132:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653dc892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11599:x1874709517005056:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787862638.960261:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960284:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960303:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960322:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960329:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960336:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960367:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960377:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960383:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862638.960445:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787862638.960451:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862638.960472:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960487:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960501:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960509:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960516:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862638.960521:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960530:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960544:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:3.0:1787862638.960548:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862638.960553:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960559:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930b5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960576:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960581:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960587:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960593:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862638.960601:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960607:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960615:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a6517c53700) 00010000:00010000:3.0:1787862638.960617:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862638.960620:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960626:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930b66 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960640:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960645:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.960651:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.963790:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422cc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862638.963802:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.963988:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.964029:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862638.964033:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862638.964085:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862638.964095:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862638.964431:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653dc892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11599:x1874709517005056:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 4293us (4881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.964454:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 216 00000100:00100000:0.0:1787862638.970124:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862638.970277:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517005312 00000100:00100000:1.0:1787862638.970290:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517005312 00000100:00100000:1.0:1787862638.970368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:1.0:1787862638.970380:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+19:11599:x1874709517005312:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862638.970411:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862638.970452:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78400/0x9c5536ccf8930b74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349f8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.970589:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.970608:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.970622:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862638.970636:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787862638.971447:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971460:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971468:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971476:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862638.971482:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971492:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971510:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:1.0:1787862638.971514:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862638.971520:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971527:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79e00/0x9c5536ccf8930b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971588:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78400/0x9c5536ccf8930b74 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f8 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.971600:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:1.0:1787862638.971602:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862638.972477:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78400/0x9c5536ccf8930b74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f8 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862638.972523:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78400, rc 0) 00000100:00100000:1.0:1787862638.972628:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517005312:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 2248us (2517us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787862638.972639:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:3.0:1787862638.984591:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862638.985097:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517005440 00000100:00100000:2.0:1787862638.985114:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517005440 00000100:00100000:2.0:1787862638.985206:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 218 00000100:00100000:2.0:1787862638.985220:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517005440:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862638.985278:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862638.985458:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517005440:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 240us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862638.985467:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 218 00000100:00100000:3.0:1787862638.995537:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862638.996490:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517005696 00000100:00100000:2.0:1787862638.996508:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517005696 00000100:00100000:2.0:1787862638.996604:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 219 00000100:00100000:2.0:1787862638.996617:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517005696:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862638.996648:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862638.996652:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787862638.996710:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6500030200/0x9c5536ccf8930b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349dc expref: 20 pid: 7147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862638.996738:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862638.996744:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862638.996761:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930b89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b349ff expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787862638.999352:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787862639.000469:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.000516:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.000535:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.000631:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930b89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ff expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.001279:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ff expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.001292:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:2.0:1787862639.001296:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862639.001300:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787862639.001479:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517005696:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 4862us (5957us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787862639.001491:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 219 00000100:00100000:1.0:1787862639.007223:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.007376:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517005952 00000100:00100000:2.0:1787862639.007391:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517005952 00000100:00100000:2.0:1787862639.007481:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 220 00000100:00100000:2.0:1787862639.007498:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651c17d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517005952:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862639.007606:0:12008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862639.007647:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ff expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.007687:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6507fe6000) 00010000:00010000:2.0:1787862639.007722:0:12008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862639.007756:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.007774:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.007789:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.007808:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.007826:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.007834:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008260:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008272:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008281:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008287:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.008293:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008302:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008325:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862639.008328:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862639.008335:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008342:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930b9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008354:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008361:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008367:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008373:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.008377:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008382:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008390:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x58fcae7c (ffff9a6507fe6c00) 00010000:00010000:2.0:1787862639.008393:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862639.008396:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.008402:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930ba5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x58fcae7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.008542:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651c17d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517005952:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 1046us (1333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862639.008551:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 220 00000100:00100000:1.0:1787862639.011587:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862639.011693:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517006080 00000100:00100000:3.0:1787862639.011708:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517006080 00000100:00100000:3.0:1787862639.011789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 221 00000100:00100000:3.0:1787862639.011802:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517006080:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862639.011842:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862639.011873:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.011921:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.011939:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.011954:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.012140:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d000/0x9c5536ccf8930bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 22 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.012158:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.012175:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787862639.012177:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862639.012180:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422cc00, rc 0) 00000100:00100000:3.0:1787862639.012250:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517006080:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 451us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.012258:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 221 00000100:00100000:3.0:1787862639.016588:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.016696:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517006336 00000100:00100000:0.0:1787862639.016711:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517006336 00000100:00100000:0.0:1787862639.016798:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 222 00000100:00100000:0.0:1787862639.016811:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517006336:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787862639.016938:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.016961:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.016993:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862639.017427:0:7147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787862639.017444:0:7147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364781400124ns, next at 365781396331ns, rc = 0 00000004:00010000:0.0:1787862639.017569:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eeb04379 reply state 000000001c0cd92c transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862639.017581:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862639.017712:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+23:11599:x1874709517006336:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 902us (1135us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787862639.017721:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 222 00010000:00010000:2.0:1787862639.020440:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.020467:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.020476:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.020483:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.020490:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.020498:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.020521:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862639.020525:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787862639.020532:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.020539:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8930bba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862639.022909:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.023121:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517006464 00000100:00100000:2.0:1787862639.023137:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517006464 00000100:00100000:2.0:1787862639.023228:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 223 00000100:00100000:2.0:1787862639.023260:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+22:11599:x1874709517006464:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862639.023294:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862639.023321:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a0d expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.023397:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 23 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.023421:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 23 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.023440:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862639.023442:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862639.023447:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc000, rc 0) 00000100:00100000:2.0:1787862639.023512:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+23:11599:x1874709517006464:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 256us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.023520:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 223 00000100:00100000:0.0:1787862639.026626:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862639.026887:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517006592 00000100:00100000:3.0:1787862639.026900:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517006592 00000100:00100000:3.0:1787862639.026982:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:3.0:1787862639.026995:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+6:2348:x1874709517006592:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787862639.027527:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709517006592:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 417us (800us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787862639.027537:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:1.0:1787862639.030156:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.030260:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517006848 00000100:00100000:2.0:1787862639.030275:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517006848 00000100:00100000:2.0:1787862639.030349:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:2.0:1787862639.030362:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+23:11599:x1874709517006848:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862639.030925:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+24:11599:x1874709517006848:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 562us (781us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787862639.030936:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:1.0:1787862639.033809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862639.033946:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517007104 00000100:00100000:3.0:1787862639.033963:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517007104 00000100:00100000:3.0:1787862639.034095:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 224 00000100:00100000:3.0:1787862639.034108:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+24:11599:x1874709517007104:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862639.034267:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+24:11599:x1874709517007104:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 161us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.034276:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 224 00000100:00100000:1.0:1787862639.037431:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.037563:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517007232 00000100:00100000:2.0:1787862639.037576:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517007232 00000100:00100000:2.0:1787862639.037697:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 225 00000100:00100000:2.0:1787862639.037713:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+24:11599:x1874709517007232:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862639.037744:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862639.037774:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a14 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.038285:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.038305:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.038325:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862639.038375:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862639.038401:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.038435:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a14 expref: 26 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.038457:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a14 expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.038467:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862639.038469:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787862639.038475:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:2.0:1787862639.038553:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+25:11599:x1874709517007232:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 844us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.038571:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 225 00000100:00100000:2.0:1787862639.041847:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862639.042015:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517007360 00000100:00100000:3.0:1787862639.042029:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517007360 00000100:00100000:3.0:1787862639.042168:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1787862639.042181:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2349:x1874709517007360:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862639.042208:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862639.042235:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a1b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862639.042269:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909e6e, blocks: 0x1 00010000:00010000:3.0:1787862639.042303:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1787862639.042308:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862639.042321:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.042342:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.042358:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d000, rc 0) 00000100:00100000:3.0:1787862639.042454:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709517007360:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 274us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.042461:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:1.0:1787862639.046716:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.046853:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517007616 00000100:00100000:0.0:1787862639.046885:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517007616 00000100:00100000:0.0:1787862639.046964:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 226 00000100:00100000:0.0:1787862639.046985:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+25:11599:x1874709517007616:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787862639.047170:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+25:11599:x1874709517007616:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 187us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862639.047177:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 226 00000100:00100000:1.0:1787862639.050485:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.050602:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517007744 00000100:00100000:2.0:1787862639.050615:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517007744 00000100:00100000:2.0:1787862639.050690:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:2.0:1787862639.050702:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:11599:x1874709517007744:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862639.050729:0:11687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862639.050754:0:11687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a22 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.050801:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.050811:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862639.050826:0:11687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862639.050833:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.050878:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.050895:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.050913:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526433664:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862639.051127:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862639.053929:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11687:1874709526433664:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862639.053998:0:11687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 9 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.054029:0:11687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:2.0:1787862639.054128:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+9:11599:x1874709517007744:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 3428us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.054139:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:3.0:1787862639.057609:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.057875:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517007872 00000100:00100000:2.0:1787862639.057889:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517007872 00010000:00010000:2.0:1787862639.057949:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.058010:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:2.0:1787862639.058022:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+9:2349:x1874709517007872:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862639.058062:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862639.058094:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.058110:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.058139:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000859d40fd/0x9c5536ccf8930bd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a1b expref: 9 pid: 6670 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.058185:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862639.058191:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862639.058201:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.058213:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.058262:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.058280:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874709526433792:192.168.202.60@tcp:105: 00000100:00100000:2.0:1787862639.058390:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862639.064386:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.064516:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874709526433792:192.168.202.60@tcp:105: 00010000:00010000:2.0:1787862639.064557:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862639.064642:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709517007872:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 6620us (7048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.064656:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787862639.065836:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517008000 00000100:00100000:3.0:1787862639.065853:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517008000 00002000:00100000:3.0:1787862639.065937:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a6534640000 x1874709517008000/t0(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:0/0 lens 504/0 e 0 to 0 dl 1787862650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862639.065950:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6534640000 with x1874709517008000 ext(0->12) 00002000:00010000:3.0:1787862639.065957:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6534640000 00000100:00100000:3.0:1787862639.066028:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:3.0:1787862639.066040:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2349:x1874709517008000:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787862639.066703:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:21567a16-68b5-41a8-a3f6-27f314a231da+10:2349:x1874709517008000:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 Request processed in 661us (2327us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787862639.066714:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00002000:00100000:3.0:1787862639.066723:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a6534640000 x1874709517008000/t4294967321(0) o4->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:0/0 lens 504/448 e 0 to 0 dl 1787862650 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862639.066732:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6534640000 with x1874709517008000 ext(0->12) 00002000:00010000:3.0:1787862639.066735:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6534640000 00000100:00100000:1.0:1787862639.070422:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862639.070714:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517008128 00000100:00100000:3.0:1787862639.070729:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517008128 00000100:00100000:3.0:1787862639.070825:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 227 00000100:00100000:3.0:1787862639.070837:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+25:11599:x1874709517008128:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787862639.118262:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1787862639.118281:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1787862639.118322:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1787862639.118340:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:2.0:1787862639.118362:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1787862639.118378:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787862639.118663:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862639.118700:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526433920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787862639.118803:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862639.118878:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526433920 00000100:00100000:1.0:1787862639.118887:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526433920 00000100:00100000:1.0:1787862639.118953:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787862639.118965:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526433920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787862639.119228:0:12006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787862639.119233:0:12006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787862639 00002000:00010000:1.0:1787862639.119235:0:12006:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862639.119238:0:12006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787862638 -> 1787862639 00002000:00010000:1.0:1787862639.119241:0:12006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787862639.119315:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3281:x1874709526433920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 352us (512us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787862639.119325:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787862639.119387:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6534643840/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787862639.119394:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526433920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787862639.119903:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517008128:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 49062us (49502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.119917:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 227 00000100:00100000:1.0:1787862639.123837:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.124096:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517008256 00000100:00100000:2.0:1787862639.124141:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517008256 00000100:00100000:2.0:1787862639.124220:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:2.0:1787862639.124234:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+10:2348:x1874709517008256:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787862639.149237:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787862639.149269:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1787862639.149436:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709517008256:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 25196us (26029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862639.149454:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:1.0:1787862639.152318:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.152529:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517008512 00000100:00100000:0.0:1787862639.152544:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517008512 00000100:00100000:0.0:1787862639.152826:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 228 00000100:00100000:0.0:1787862639.152840:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517008512:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787862639.152939:0:7147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862639.152989:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a14 expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.153016:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862639.153022:0:7147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862639.153138:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.153156:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.153167:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862639.154179:0:7147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6052f1f reply state 00000000c0c067ef transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862639.154200:0:7147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862639.154374:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+22:11599:x1874709517008512:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 1534us (2069us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787862639.154385:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 228 00000100:00100000:2.0:1787862639.158129:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862639.158204:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517008640 00000100:00100000:1.0:1787862639.158215:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517008640 00000100:00100000:1.0:1787862639.158277:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:1.0:1787862639.158291:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2348:x1874709517008640:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787862639.158641:0:11687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787862639.158644:0:11687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787862639 -> 1787862637 00002000:00010000:1.0:1787862639.158646:0:11687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787862637 00002000:00010000:1.0:1787862639.158648:0:11687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787862639 -> 1787862637 00002000:00010000:1.0:1787862639.158650:0:11687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787862639.158721:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709517008640:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 433us (610us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787862639.158729:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 69 00010000:00010000:0.0:1787862639.160509:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.160532:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.160540:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.160547:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862639.160553:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.160563:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.160584:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862639.160587:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862639.160594:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.160601:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8930be4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862639.160750:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.160839:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517008896 00000100:00100000:0.0:1787862639.160852:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517008896 00000100:00100000:0.0:1787862639.160978:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 229 00000100:00100000:0.0:1787862639.160991:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+21:11599:x1874709517008896:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787862639.161122:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.161135:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.161143:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.161175:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.161185:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 21 pid: 5817 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862639.161199:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511602940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526434048:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862639.161291:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c205f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862639.163564:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.163585:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511602940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874709526434048:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862639.163618:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.163781:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517009024 00000100:00100000:2.0:1787862639.163788:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517009024 00010000:00010000:2.0:1787862639.163831:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 22 pid: 5817 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.163880:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:2.0:1787862639.163890:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+22:2348:x1874709517009024:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862639.163907:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862639.163912:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 22 pid: 5817 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.163926:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 22 pid: 5817 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.163953:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422cc00/0x9c5536ccf8930bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a06 expref: 22 pid: 5817 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.163983:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862639.163988:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.164000:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.164026:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.164134:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862639.164191:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+21:2348:x1874709517009024:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 302us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.164198:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00010000:00010000:0.0:1787862639.164979:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.164989:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.165025:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.167504:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.167538:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.167546:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862639.167554:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.167567:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.167595:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862639.167599:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787862639.167605:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.167612:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930beb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862639.168138:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517008896:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 Request processed in 7139us (7379us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787862639.168154:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 229 00000100:00100000:3.0:1787862639.170852:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862639.170922:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517009152 00000100:00100000:1.0:1787862639.170935:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517009152 00000100:00100000:1.0:1787862639.171023:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:1.0:1787862639.171036:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653464a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709517009152:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787862639.171164:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.171191:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.171202:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862639.171208:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787862639.171212:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.171251:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 8 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.171266:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 8 pid: 11687 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862639.171282:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65099f61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526434176:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862639.171381:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787862639.173891:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862639.173981:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65099f61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1874709526434176:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862639.174020:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862639.174246:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517009280 00000100:00100000:0.0:1787862639.174253:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517009280 00010000:00010000:2.0:1787862639.174367:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 9 pid: 11687 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.174491:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:2.0:1787862639.174502:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+9:2348:x1874709517009280:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862639.174522:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862639.174552:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 9 pid: 11687 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.174564:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 9 pid: 11687 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.174587:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeb29e8b/0x9c5536ccf8930bdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a22 expref: 9 pid: 11687 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.174603:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862639.174607:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862639.174613:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.174636:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174697:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174717:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.174742:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862639.174751:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174760:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174769:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174776:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862639.174781:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174791:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174806:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.174824:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b37dff70/0x9c5536ccf8930bf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.174860:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2348:x1874709517009280:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 359us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.174868:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:3.0:1787862639.174895:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653464a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709517009152:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 3863us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.174905:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:1.0:1787862639.177321:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.177400:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517009536 00000100:00100000:0.0:1787862639.177462:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517009536 00000100:00100000:0.0:1787862639.177535:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 230 00000100:00100000:0.0:1787862639.177546:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+20:11599:x1874709517009536:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787862639.177892:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.177915:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.177932:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.178515:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.178532:0:12007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 21 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.178556:0:12007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.178603:0:12007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 21 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.178623:0:12007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 21 pid: 12008 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862639.178642:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65099f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526434304:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862639.178992:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787862639.183675:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.183896:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65099f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526434304:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862639.183934:0:12007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862639.184039:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517009664 00000100:00100000:3.0:1787862639.184108:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517009664 00010000:00010000:3.0:1787862639.184164:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 22 pid: 12008 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862639.184247:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862639.184258:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+22:2349:x1874709517009664:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862639.184276:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862639.184283:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 22 pid: 12008 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.184295:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 22 pid: 12008 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.184318:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc000/0x9c5536ccf8930bc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a0d expref: 22 pid: 12008 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.184346:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787862639.184352:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.184363:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.184398:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.184545:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862639.184634:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21567a16-68b5-41a8-a3f6-27f314a231da+21:2349:x1874709517009664:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 376us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.184643:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00010000:00010000:1.0:1787862639.185896:0:12007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.185913:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862639.186234:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787862639.186603:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787862639.186643:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787862639.186762:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65099f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526434432:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787862639.186850:0:12007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862639.186948:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862639.187482:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526434432 00000100:00100000:0.0:1787862639.187493:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526434432 00000100:00100000:1.0:1787862639.187683:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787862639.187696:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12007:x1874709526434432:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787862639.187860:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12007:x1874709526434432:12345-0@lo:1000:mdt00_004.0 Request processed in 166us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862639.187875:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862639.187960:0:12007:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1787862639.187978:0:12007:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6402a8cf00, transno 4294967319 00000004:00080000:2.0:1787862639.187998:0:12007:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6534643840, transno 4294967322 00000100:00100000:2.0:1787862639.188006:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65099f7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526434432:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787862639.188756:0:12007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787862639.188844:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526434560:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787862639.188897:0:12007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862639.189661:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787862639.189777:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526434560 00000100:00100000:3.0:1787862639.189785:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526434560 00000100:00100000:3.0:1787862639.189831:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787862639.189840:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401863840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12007:x1874709526434560:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787862639.190241:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401863840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12007:x1874709526434560:12345-0@lo:1000:mdt00_004.0 Request processed in 401us (1342us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787862639.190250:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862639.190402:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12007:1874709526434560:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787862639.190517:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190530:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190555:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190562:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.190568:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190577:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190596:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862639.190600:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862639.190605:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190613:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b78000/0x9c5536ccf8930c00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190649:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190655:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190661:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190729:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.190733:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190749:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190759:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862639.190762:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862639.190771:0:12007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190784:0:12007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190793:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.190830:0:12007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.190844:0:12007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526434688:192.168.202.60@tcp:105: 00000100:00100000:2.0:1787862639.190976:0:12007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787862639.197517:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.197954:0:12007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12007:1874709526434688:192.168.202.60@tcp:105: 00010000:00010000:2.0:1787862639.198008:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198022:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930b43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198145:0:12007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198181:0:12007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198193:0:12007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198204:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198209:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198215:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198219:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.198223:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198228:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198239:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862639.198242:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862639.198247:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198252:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198263:0:12007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198276:0:12007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198282:0:12007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198287:0:12007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862639.198289:0:12007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198293:0:12007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198298:0:12007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862639.198300:0:12007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787862639.198302:0:12007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.198306:0:12007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636400/0x9c5536ccf8930bf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.198728:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862639.198906:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:21567a16-68b5-41a8-a3f6-27f314a231da+24:11599:x1874709517009536:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 21359us (21598us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787862639.198918:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 230 00000020:00080000:2.0:1787862639.198927:0:12007:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787862639.199084:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517009792 00000100:00100000:3.0:1787862639.199093:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517009792 00000100:00100000:3.0:1787862639.199151:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:3.0:1787862639.199165:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+24:11598:x1874709517009792:12345-192.168.202.60@tcp:49:lfs.0 00000100:00100000:3.0:1787862639.199291:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+24:11598:x1874709517009792:12345-192.168.202.60@tcp:49:lfs.0 Request processed in 129us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862639.199300:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:1.0:1787862639.203261:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862639.203343:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000040:00080000:0.0:1787862639.203720:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862639.203727:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862639.204143:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787862639.204151:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862639.204636:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517010304 00000100:00100000:3.0:1787862639.204650:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517010304 00000100:00100000:3.0:1787862639.204744:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:3.0:1787862639.204758:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+24:11599:x1874709517010304:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787862639.205613:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787862639.205734:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787862639.205791:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.205810:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.205825:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.205835:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.205842:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.205849:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862639.206485:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787862639.206635:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+26:11599:x1874709517010304:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 1876us (3286us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787862639.206645:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000020:00080000:3.0:1787862639.206652:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787862639.213067:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517010048 00000100:00100000:2.0:1787862639.213102:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517010048 00000100:00100000:2.0:1787862639.213199:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 231 00000100:00100000:2.0:1787862639.213214:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+26:11598:x1874709517010048:12345-192.168.202.60@tcp:58:lfs.0 00000040:00080000:2.0:1787862639.213620:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787862639.214336:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+26:11598:x1874709517010048:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 1118us (11081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862639.214350:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 231 00010000:00010000:1.0:1787862639.217131:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862639.217153:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.217168:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862639.217173:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.217186:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.217210:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6517c53900) 00010000:00010000:1.0:1787862639.217213:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862639.217219:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.217227:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c600/0x9c5536ccf8930c0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.217257:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862639.217259:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862639.217262:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862639.257657:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862639.258418:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517010432 00000100:00100000:2.0:1787862639.258436:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517010432 00000100:00100000:2.0:1787862639.258513:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 232 00000100:00100000:2.0:1787862639.258526:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+26:11601:x1874709517010432:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862639.258562:0:12008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862639.258591:0:12008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a29 expref: -99 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.258901:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.258922:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.258941:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.258962:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.258981:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.258988:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.260550:0:12008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.260577:0:12008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 27 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.260587:0:12008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.260641:0:12008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 27 pid: 12007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862639.260664:0:12008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 27 pid: 12007 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862639.260999:0:12008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526434816:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862639.261224:0:12008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862639.266269:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.266451:0:12008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12008:1874709526434816:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862639.266501:0:12008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862639.266676:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517010688 00000100:00100000:3.0:1787862639.266687:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517010688 00000100:00100000:3.0:1787862639.266773:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:3.0:1787862639.266785:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+28:9943:x1874709517010688:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787862639.267235:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:9943:x1874709517010688:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 450us (982us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787862639.267244:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:3.0:1787862639.271550:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862639.272289:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517010816 00000100:00100000:0.0:1787862639.272307:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517010816 00010000:00010000:0.0:1787862639.272382:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 29 pid: 12007 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862639.272450:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:0.0:1787862639.272462:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401861680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:2349:x1874709517010816:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862639.272481:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862639.272489:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 29 pid: 12007 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.272530:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 29 pid: 12007 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.272562:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637a00/0x9c5536ccf8930b35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b349ea expref: 29 pid: 12007 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.272583:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:0.0:1787862639.272590:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.272602:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.272611:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862639.272654:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862639.273106:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401861680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21567a16-68b5-41a8-a3f6-27f314a231da+28:2349:x1874709517010816:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 642us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862639.273117:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00010000:00010000:1.0:1787862639.273229:0:12008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273256:0:12008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862639.273320:0:12008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787862639.273327:0:12008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862639.273355:0:12008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273372:0:12008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273383:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273389:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273396:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273477:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862639.273484:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273494:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273508:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862639.273512:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862639.273516:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273534:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8930c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273562:0:12008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273574:0:12008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273579:0:12008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273584:0:12008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862639.273588:0:12008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273594:0:12008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273602:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6507fe6000) 00010000:00010000:1.0:1787862639.273605:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862639.273608:0:12008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273614:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8930c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273661:0:12008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8930c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a29 expref: 28 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273778:0:12008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a29 expref: 27 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862639.273786:0:12008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:1.0:1787862639.273788:0:12008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862639.273791:0:12008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:1.0:1787862639.275211:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+27:11601:x1874709517010432:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 16670us (17555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862639.275229:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 232 00010000:00010000:2.0:1787862640.220945:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862640.223011:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862640.223022:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862640.223109:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787862640.223117:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787862640.223285:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511602940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526434944:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862640.223430:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c205540 going to sleep for 11 seconds 00000100:00100000:2.0:1787862640.239745:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862640.239896:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517010944 00000100:00100000:1.0:1787862640.239910:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517010944 00000100:00100000:1.0:1787862640.240020:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 233 00000100:00100000:3.0:1787862640.240026:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511602940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1874709526434944:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787862640.240032:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+28:11612:x1874709517010944:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862640.240111:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862640.240262:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+27:11612:x1874709517010944:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 232us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862640.240271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 233 00000100:00080000:1.0:1787862640.240303:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862640.254834:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862640.255526:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517011200 00000100:00100000:2.0:1787862640.255542:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517011200 00000100:00100000:2.0:1787862640.255613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 234 00000100:00100000:2.0:1787862640.255627:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64018630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+27:11612:x1874709517011200:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862640.255652:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862640.255779:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.255955:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.255986:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.256004:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862640.256018:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787862640.256248:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a30 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.256270:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a30 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.256280:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862640.256283:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862640.256288:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c000, rc 0) 00000100:00100000:3.0:1787862640.256395:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64018630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:11612:x1874709517011200:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 771us (1577us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787862640.256406:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 234 00000100:00100000:1.0:1787862640.264497:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862640.275852:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517011328 00000100:00100000:3.0:1787862640.275879:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517011328 00000100:00100000:3.0:1787862640.275993:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1787862640.276006:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+29:2348:x1874709517011328:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862640.276025:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862640.276080:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a30 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.276101:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862640.276109:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862640.276217:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21567a16-68b5-41a8-a3f6-27f314a231da+28:2348:x1874709517011328:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 205us (11778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862640.276226:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1787862640.277503:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862640.277814:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517011584 00000100:00100000:3.0:1787862640.277825:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517011584 00000100:00100000:3.0:1787862640.277879:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 235 00000100:00100000:3.0:1787862640.277889:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511603840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+28:11612:x1874709517011584:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787862640.277991:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278012:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278024:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278828:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278843:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278861:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278868:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862640.278874:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278882:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278896:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862640.278899:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862640.278905:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.278912:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862640.279102:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511603840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+29:11612:x1874709517011584:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 1213us (1605us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787862640.279120:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 235 00000040:00080000:0.0:1787862640.280919:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862640.280939:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862640.283875:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787862640.283890:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787862640.284759:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862640.285368:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517011840 00000100:00100000:3.0:1787862640.285384:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517011840 00000100:00100000:2.0:1787862640.288020:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526435072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862640.288021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:3.0:1787862640.288085:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+29:11612:x1874709517011840:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787862640.288222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862640.288302:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435072 00000100:00100000:2.0:1787862640.288312:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435072 00000100:00100000:2.0:1787862640.288379:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787862640.288391:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526435072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862640.288438:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862640.288498:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526435072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862640.288506:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787862640.288532:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862640.288581:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526435072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862640.291155:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+30:11612:x1874709517011840:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 3096us (6385us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787862640.291180:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 64 00000040:00080000:0.0:1787862640.349393:0:12507:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787862640.349410:0:12507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862640.349473:0:12507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787862640.349480:0:12507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862640.747265:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862640.748009:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012096 00000100:00100000:3.0:1787862640.748025:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012096 00000100:00100000:3.0:1787862640.748140:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 236 00000100:00100000:3.0:1787862640.748153:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+30:11625:x1874709517012096:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862640.748187:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862640.748216:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a37 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.748375:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.748396:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.748412:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862640.748426:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787862640.748614:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d400/0x9c5536ccf8930c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a37 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.748637:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a37 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.748647:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862640.748667:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787862640.748673:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c000, rc 0) 00000100:00100000:3.0:1787862640.748775:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21567a16-68b5-41a8-a3f6-27f314a231da+32:11625:x1874709517012096:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 624us (1528us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787862640.748804:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 236 00000100:00100000:2.0:1787862640.772711:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862640.772907:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012224 00000100:00100000:3.0:1787862640.772923:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012224 00000100:00100000:3.0:1787862640.773013:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 237 00000100:00100000:3.0:1787862640.773026:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+32:11625:x1874709517012224:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:3.0:1787862640.773148:0:7147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773171:0:7147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773186:0:7147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773221:0:7147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773229:0:7147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773237:0:7147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773244:0:7147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862640.773250:0:7147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773259:0:7147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773272:0:7147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862640.773292:0:7147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862640.773300:0:7147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862640.773307:0:7147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d800/0x9c5536ccf8930c62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862640.773423:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21567a16-68b5-41a8-a3f6-27f314a231da+32:11625:x1874709517012224:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 398us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862640.773432:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 237 00000100:00100000:2.0:1787862640.901170:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862640.901281:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012352 00000100:00100000:1.0:1787862640.901294:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012352 00000100:00100000:1.0:1787862640.901373:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:1.0:1787862640.901384:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2346:x1874709517012352:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:1.0:1787862640.901416:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862640.901453:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000171d7d2c/0x9c5536ccf8930c69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a3e expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862640.901483:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a909e6d, atime: 0x6a909e6d, ctime: 0x6a909e6d, blocks: 0xb 00010000:00010000:1.0:1787862640.901509:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1787862640.901514:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862640.901526:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171d7d2c/0x9c5536ccf8930c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a3e expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862640.901545:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000171d7d2c/0x9c5536ccf8930c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a3e expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862640.901558:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78400, rc 0) 00000100:00100000:1.0:1787862640.901623:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+8:2346:x1874709517012352:12345-192.168.202.60@tcp:101:cat.0 Request processed in 241us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862640.901630:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00080000:2.0:1787862640.902163:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862640.910190:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862640.910343:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012480 00000100:00100000:3.0:1787862640.910354:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012480 00002000:00100000:3.0:1787862640.910426:0:6675:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a651fae9a40 x1874709517012480/t0(0) o3->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:1/0 lens 488/0 e 0 to 0 dl 1787862651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862640.910438:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a651fae9a40 with x1874709517012480 ext(0->4095) 00002000:00010000:3.0:1787862640.910445:0:6675:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a651fae9a40 00000100:00100000:3.0:1787862640.910534:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1787862640.910548:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709517012480:12345-192.168.202.60@tcp:3:cat.0 00000100:00100000:3.0:1787862640.910825:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709517012480:12345-192.168.202.60@tcp:3:cat.0 Request processed in 279us (648us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787862640.910834:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00002000:00100000:3.0:1787862640.910842:0:6675:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a651fae9a40 x1874709517012480/t0(0) o3->21567a16-68b5-41a8-a3f6-27f314a231da@192.168.202.60@tcp:1/0 lens 488/4536 e 0 to 0 dl 1787862651 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787862640.910851:0:6675:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a651fae9a40 with x1874709517012480 ext(0->4095) 00002000:00010000:3.0:1787862640.910854:0:6675:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a651fae9a40 00010000:00010000:0.0:1787862641.248988:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862642.269690:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862642.906194:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862642.906490:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862642.906546:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862642.906571:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862642.906619:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862642.906673:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012864 00000100:00100000:3.0:1787862642.906687:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012864 00000100:00100000:3.0:1787862642.906757:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012992 00000100:00100000:3.0:1787862642.906760:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012992 00000100:00100000:3.0:1787862642.906787:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:3.0:1787862642.906800:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709517012864:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862642.906904:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+8:2347:x1874709517012864:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 106us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862642.906912:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:3.0:1787862642.906932:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:3.0:1787862642.906951:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709517012992:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862642.906977:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709517012992:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862642.906983:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:3.0:1787862642.907003:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517013120 00000100:00100000:3.0:1787862642.907007:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517013120 00000100:00100000:3.0:1787862642.907036:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012736 00000100:00100000:3.0:1787862642.907038:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012736 00000100:00100000:3.0:1787862642.907090:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00100000:3.0:1787862642.907097:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709517013120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862642.907126:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+5:2347:x1874709517013120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862642.907132:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00100000:3.0:1787862642.907151:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 184 00000100:00100000:3.0:1787862642.907156:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401862d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+32:2347:x1874709517012736:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862642.907185:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401862d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+32:2347:x1874709517012736:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862642.907191:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 184 00000100:00080000:3.0:1787862642.907215:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862642.907221:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862642.907223:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862642.933283:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517012608 00000100:00100000:0.0:1787862642.933308:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517012608 00000100:00100000:0.0:1787862642.933566:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 310 00000100:00100000:0.0:1787862642.933579:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709517012608:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862642.933714:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709517012608:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 137us (27534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862642.933723:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 310 00000001:00080000:2.0:1787862642.983946:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1787862643.297289:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862643.356747:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526435584:0@lo:400:kworker.0 00000100:00100000:3.0:1787862643.356851:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862643.356958:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787862643.356966:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511602940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526435200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862643.357019:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862643.357074:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526435712:0@lo:400:kworker.0 00000100:00100000:1.0:1787862643.357076:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526435328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862643.357105:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862643.357136:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435712 00000100:00100000:3.0:1787862643.357144:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435200 00000100:00100000:3.0:1787862643.357146:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435200 00000100:00100000:1.0:1787862643.357146:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435712 00000100:00100000:3.0:1787862643.357203:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787862643.357203:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787862643.357214:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526435200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862643.357214:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862643.357342:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526435456:0@lo:400:kworker.0 00000100:00100000:2.0:1787862643.357379:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862643.357422:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435456 00000100:00100000:2.0:1787862643.357426:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435456 00000100:00100000:2.0:1787862643.357461:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787862643.357468:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526435456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862643.357506:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526435456:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862643.357514:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787862643.357571:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526435456:0@lo:400:kworker.0 00000100:00100000:0.0:1787862643.357666:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435584 00000100:00100000:0.0:1787862643.357671:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435584 00000100:00100000:0.0:1787862643.357719:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787862643.357727:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862643.358772:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3283:x1874709526435200:12345-0@lo:400:kworker.0 Request processed in 1550us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862643.358784:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787862643.363592:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526435712:12345-0@lo:400:kworker.0 Request processed in 6361us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862643.363647:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1787862643.363742:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862643.363752:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862643.363779:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862643.363856:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526435840:0@lo:400:kworker.0 00000100:00100000:1.0:1787862643.363964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862643.364033:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435840 00000100:00100000:1.0:1787862643.364067:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435840 00000100:00100000:1.0:1787862643.364140:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787862643.364151:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526435840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862643.364219:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526435840:12345-0@lo:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862643.364226:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1787862643.364249:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862643.364280:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787862643.364288:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a653460d680, transno 4294967310 00000100:00100000:1.0:1787862643.364303:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526435840:0@lo:400:kworker.0 00000100:00100000:2.0:1787862643.365060:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435328 00000100:00100000:2.0:1787862643.365088:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435328 00000100:00100000:2.0:1787862643.365141:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787862643.365150:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526435328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862643.365235:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526435328:12345-0@lo:400:kworker.0 Request processed in 87us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862643.365242:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787862643.365438:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526435328:0@lo:400:kworker.0 00000100:00100000:0.0:1787862643.365973:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526435584:12345-0@lo:400:kworker.0 Request processed in 8243us (9116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862643.365984:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787862643.367550:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511602940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526435200:0@lo:400:kworker.0 00000100:00100000:3.0:1787862643.367611:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526435712:0@lo:400:kworker.0 00000100:00100000:3.0:1787862643.367708:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526435584:0@lo:400:kworker.0 00000100:00100000:2.0:1787862643.869761:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862643.869796:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526435968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862643.869896:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862643.870015:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526435968 00000100:00100000:2.0:1787862643.870025:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526435968 00000100:00100000:2.0:1787862643.870116:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862643.870128:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526435968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862643.870187:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862643.870243:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526435968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862643.870252:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787862643.870319:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526435968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862644.320533:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787862644.473847:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000001:00080000:2.0:1787862644.473863:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000001:00080000:2.0:1787862644.473884:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:2.0:1787862644.473891:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6402fd6300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787862644.473897:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6403047600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6402fd66c0 00000020:00080000:2.0:1787862644.473901:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6403047900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a651ff1ec00 00000001:00080000:2.0:1787862644.473913:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787862644.473969:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787862644.474198:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1787862644.486838:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1787862644.486863:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1787862645.340970:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862645.404867:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862645.404897:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526436096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862645.405007:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862645.405949:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436096 00000100:00100000:3.0:1787862645.405964:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436096 00000100:00100000:3.0:1787862645.406088:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862645.406102:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526436096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862645.406157:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862645.406881:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526436096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 775us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862645.406893:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787862645.407006:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862645.409437:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787862645.409456:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787862645.409513:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526436096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862646.367760:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862647.392155:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862647.609211:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862647.609378:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517013248 00000100:00100000:2.0:1787862647.609395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517013248 00000100:00100000:2.0:1787862647.609506:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00100000:2.0:1787862647.609522:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11278:x1874709517013248:12345-192.168.202.60@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787862647.609678:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11278:x1874709517013248:12345-192.168.202.60@tcp:60:lhsmtool_posix.0 Request processed in 161us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862647.609686:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00080000:1.0:1787862647.609992:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862647.626172:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862647.626368:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517013504 00000100:00100000:3.0:1787862647.626379:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517013504 00000100:00100000:3.0:1787862647.626445:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1787862647.626456:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+19:11278:x1874709517013504:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787862647.627027:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+20:11278:x1874709517013504:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 570us (2067us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787862647.627036:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:0.0:1787862647.988465:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862647.988796:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517013632 00000100:00100000:2.0:1787862647.988813:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517013632 00000100:00100000:2.0:1787862647.989000:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 239 00000100:00100000:2.0:1787862647.989014:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+5:12077:x1874709517013632:12345-192.168.202.60@tcp:101:lsof.0 00010000:00010000:2.0:1787862647.989091:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862647.989137:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a45 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862647.989229:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862647.989248:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862647.989285:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862647.989554:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862647.989559:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862647.989667:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862647.990443:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918600/0x9c5536ccf8930c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a45 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862647.990470:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a45 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862647.990480:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:2.0:1787862647.990483:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862647.990488:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00080000:1.0:1787862647.990807:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862647.990907:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09001ba1-03f5-4db1-a589-c226f7e46380+6:12077:x1874709517013632:12345-192.168.202.60@tcp:101:lsof.0 Request processed in 1893us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862647.990918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 239 00000100:00100000:0.0:1787862648.009949:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862648.010004:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862648.010093:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862648.010215:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517013760 00000100:00100000:1.0:1787862648.010228:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517013760 00000100:00100000:1.0:1787862648.010296:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 312 00000100:00100000:1.0:1787862648.010306:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709517013760:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862648.010440:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2347:x1874709517013760:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 133us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862648.010450:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 312 00000100:00100000:2.0:1787862648.012349:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517013888 00000100:00100000:2.0:1787862648.012371:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517013888 00000100:00100000:2.0:1787862648.012474:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014016 00000100:00100000:2.0:1787862648.012478:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014016 00000100:00100000:2.0:1787862648.012516:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:2.0:1787862648.012528:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709517013888:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862648.012648:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+7:2347:x1874709517013888:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 122us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862648.012688:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:2.0:1787862648.012708:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:2.0:1787862648.012716:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709517014016:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862648.012748:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21567a16-68b5-41a8-a3f6-27f314a231da+5:2347:x1874709517014016:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862648.012755:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00080000:0.0:1787862648.013462:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862648.013468:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862648.412287:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862648.477280:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526436224:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.477412:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.477539:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526436736:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.477577:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.479094:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862648.479116:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526436608:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.479185:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.479239:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526436352:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.479271:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.479293:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65400ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526436864:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.479317:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.479338:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862648.479345:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526436480:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.479370:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.479405:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436608 00000100:00100000:2.0:1787862648.479416:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436608 00000100:00100000:2.0:1787862648.479507:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436864 00000100:00100000:2.0:1787862648.479531:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436864 00000100:00100000:2.0:1787862648.479567:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000040:00080000:3.0:1787862648.480279:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862648.480287:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862648.480675:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787862648.480683:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787862648.480872:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436736 00000100:00100000:3.0:1787862648.480891:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436736 00000100:00100000:3.0:1787862648.480944:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436352 00000100:00100000:3.0:1787862648.480949:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436352 00000100:00100000:3.0:1787862648.480968:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436480 00000100:00100000:3.0:1787862648.480971:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436480 00000100:00100000:3.0:1787862648.480996:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787862648.481005:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526436736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862648.481144:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526436736:12345-0@lo:400:kworker.0 Request processed in 140us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862648.481154:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787862648.481292:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526436608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.481342:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526436608:12345-0@lo:400:kworker.0 Request processed in 1767us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862648.481351:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787862648.481371:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787862648.481380:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526436864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.481422:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526436864:12345-0@lo:400:kworker.0 Request processed in 44us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862648.481429:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787862648.481449:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862648.481455:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862648.481458:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862648.482792:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787862648.482821:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862648.482921:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526436352:12345-0@lo:400:kworker.0 Request processed in 115us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862648.482928:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787862648.482959:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787862648.482968:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862648.483005:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526436480:12345-0@lo:400:kworker.0 Request processed in 39us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862648.483010:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787862648.483117:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526436608:0@lo:400:kworker.0 00000100:00100000:3.0:1787862648.483135:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526436736:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.483297:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65400ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526436864:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.483326:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526436480:0@lo:400:kworker.0 00000100:00100000:2.0:1787862648.483338:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526436352:0@lo:400:kworker.0 00000100:00100000:0.0:1787862648.493787:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436224 00000100:00100000:0.0:1787862648.493812:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436224 00000100:00100000:0.0:1787862648.493930:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787862648.493943:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526436224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862648.494113:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526436224:12345-0@lo:400:kworker.0 Request processed in 173us (16701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862648.494122:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787862648.494211:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526436224:0@lo:400:kworker.0 00000100:00100000:3.0:1787862648.989071:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862648.989172:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862648.991760:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526436992 00000100:00100000:2.0:1787862648.991784:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526436992 00000100:00100000:2.0:1787862648.991901:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787862648.991915:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526436992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862648.991971:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862648.992146:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526436992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862648.992154:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787862648.992429:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526436992:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862649.438018:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787862649.626241:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787862649.626387:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787862649.626407:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1787862649.630906:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:1.0:1787862650.466930:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862650.526163:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526437120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862650.526294:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862650.527778:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437120 00000100:00100000:3.0:1787862650.527803:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437120 00000100:00100000:3.0:1787862650.527950:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787862650.527969:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526437120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862650.528102:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862650.528238:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526437120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862650.528256:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787862650.528679:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862650.528842:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526437120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862651.491287:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787862652.324244:0:12712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:30:50 (1787862650) 00010000:00010000:0.0:1787862652.508749:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862653.131345:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862653.131386:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862653.131451:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862653.131515:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862653.131625:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862653.131665:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014528 00000100:00100000:1.0:1787862653.131677:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014528 00000100:00100000:1.0:1787862653.131749:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014400 00000100:00100000:1.0:1787862653.131753:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014400 00000100:00100000:1.0:1787862653.131785:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:1.0:1787862653.131796:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709517014528:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862653.131903:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+5:2346:x1874709517014528:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 108us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.131912:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:1.0:1787862653.131937:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:1.0:1787862653.131944:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2346:x1874709517014400:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862653.131974:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2346:x1874709517014400:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.131992:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:1.0:1787862653.132014:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014144 00000100:00100000:1.0:1787862653.132018:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014144 00000100:00100000:1.0:1787862653.132089:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 314 00000100:00100000:1.0:1787862653.132097:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709517014144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862653.132126:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2346:x1874709517014144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.132133:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 314 00000100:00100000:1.0:1787862653.132175:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014272 00000100:00100000:1.0:1787862653.132179:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014272 00000100:00100000:1.0:1787862653.132211:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014656 00000100:00100000:1.0:1787862653.132214:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014656 00000100:00100000:1.0:1787862653.132234:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:1.0:1787862653.132241:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65400a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+19:2346:x1874709517014272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862653.132280:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65400a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:21567a16-68b5-41a8-a3f6-27f314a231da+19:2346:x1874709517014272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 39us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.132287:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:1.0:1787862653.132300:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00100000:1.0:1787862653.132305:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+6:2346:x1874709517014656:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862653.132328:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+6:2346:x1874709517014656:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.132334:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00080000:1.0:1787862653.132352:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862653.132358:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862653.132359:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862653.532374:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862653.596902:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526437376:0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.597008:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862653.597129:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526437248:0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.597172:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862653.597233:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526437760:0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.597262:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526437632:0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.597291:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862653.597342:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437248 00000100:00100000:1.0:1787862653.597353:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437248 00000100:00100000:1.0:1787862653.597409:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787862653.597420:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.597485:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526437248:12345-0@lo:400:kworker.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.597493:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787862653.597538:0:11687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437632 00000100:00100000:1.0:1787862653.597542:0:11687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437632 00000100:00100000:1.0:1787862653.597604:0:11687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787862653.597611:0:11687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526437632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.597649:0:11687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526437632:12345-0@lo:400:kworker.0 Request processed in 38us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.597655:0:11687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1787862653.597678:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862653.597715:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526437632:0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.597954:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526437888:0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.597983:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862653.598003:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862653.598011:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526437504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.598064:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862653.598118:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437376 00000100:00100000:0.0:1787862653.598124:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437376 00000100:00100000:0.0:1787862653.598153:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437504 00000100:00100000:0.0:1787862653.598157:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437504 00000100:00100000:0.0:1787862653.598181:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787862653.598188:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.598231:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526437376:12345-0@lo:400:kworker.0 Request processed in 44us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862653.598237:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787862653.598251:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787862653.598257:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526437504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.598286:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526437504:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862653.598292:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787862653.598322:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526437504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.598333:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526437376:0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.598490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862653.598538:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526437248:0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.598566:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437888 00000100:00100000:1.0:1787862653.598570:0:12006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437888 00000100:00100000:0.0:1787862653.598665:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526437760 00000100:00100000:0.0:1787862653.598670:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526437760 00000100:00100000:0.0:1787862653.598700:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787862653.598706:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526437760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862653.598748:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526437760:12345-0@lo:400:kworker.0 Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862653.598754:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787862653.598812:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787862653.598831:0:12006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526437888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.598883:0:12006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526437888:12345-0@lo:400:kworker.0 Request processed in 54us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862653.598890:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1787862653.598915:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862653.598920:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862653.598945:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526437760:0@lo:400:kworker.0 00000100:00100000:1.0:1787862653.598968:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526437888:0@lo:400:kworker.0 00000100:00100000:0.0:1787862654.108712:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526438016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862654.108844:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862654.109535:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438016 00000100:00100000:3.0:1787862654.109548:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438016 00000100:00100000:3.0:1787862654.109644:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787862654.109657:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526438016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862654.109724:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862654.109802:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526438016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862654.109811:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787862654.109892:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526438016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862654.563003:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862655.580841:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862655.644865:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526438144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862655.644981:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862655.645174:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438144 00000100:00100000:3.0:1787862655.645187:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438144 00000100:00100000:3.0:1787862655.645278:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787862655.645292:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526438144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862655.645349:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862655.645415:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526438144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862655.645426:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787862655.645721:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862655.646105:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526438144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862656.604449:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862657.052606:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862657.053194:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517014912 00000100:00100000:0.0:1787862657.053211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517014912 00000100:00100000:0.0:1787862657.053327:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:0.0:1787862657.053342:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+19:12298:x1874709517014912:12345-192.168.202.60@tcp:35:umount.0 00000100:00100000:0.0:1787862657.054189:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+20:12298:x1874709517014912:12345-192.168.202.60@tcp:35:umount.0 Request processed in 846us (1595us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787862657.054203:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00080000:2.0:1787862657.055462:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862657.060515:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862657.061097:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517015168 00000100:00100000:0.0:1787862657.061115:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517015168 00000100:00100000:0.0:1787862657.061202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:0.0:1787862657.061215:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+20:12298:x1874709517015168:12345-192.168.202.60@tcp:35:umount.0 00000100:00100000:0.0:1787862657.062829:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:21567a16-68b5-41a8-a3f6-27f314a231da+21:12298:x1874709517015168:12345-192.168.202.60@tcp:35:umount.0 Request processed in 1592us (2318us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787862657.062846:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:1.0:1787862657.065522:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862657.065684:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517015424 00000100:00100000:3.0:1787862657.065697:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517015424 00000100:00100000:3.0:1787862657.065775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:3.0:1787862657.065789:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6504d27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+21:12298:x1874709517015424:12345-192.168.202.60@tcp:35:umount.0 00000100:00100000:3.0:1787862657.066546:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6504d27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+22:12298:x1874709517015424:12345-192.168.202.60@tcp:35:umount.0 Request processed in 754us (1044us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787862657.066559:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:2.0:1787862657.070646:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862657.070991:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517015680 00000100:00100000:3.0:1787862657.071006:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517015680 00000100:00100000:3.0:1787862657.071157:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:3.0:1787862657.071171:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+22:12298:x1874709517015680:12345-192.168.202.60@tcp:35:umount.0 00000100:00100000:3.0:1787862657.072478:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21567a16-68b5-41a8-a3f6-27f314a231da+23:12298:x1874709517015680:12345-192.168.202.60@tcp:35:umount.0 Request processed in 1297us (2075us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787862657.072496:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:1.0:1787862657.079950:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862657.080112:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862657.080135:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862657.080174:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862657.080215:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517016064 00000100:00100000:1.0:1787862657.080228:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517016064 00000100:00100000:1.0:1787862657.080328:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517015936 00000100:00100000:1.0:1787862657.080332:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517015936 00000100:00100000:1.0:1787862657.080346:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517016192 00000100:00100000:1.0:1787862657.080349:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517016192 00000100:00100000:1.0:1787862657.080366:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862657.080379:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6512573c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+15:2348:x1874709517016064:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862657.080401:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862657.080429:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af44600/0x9c5536ccf892fc55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34598 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862657.080488:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862657.080582:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6512573c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+14:2348:x1874709517016064:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 205us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862657.080592:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862657.080662:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:1.0:1787862657.080685:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+13:2348:x1874709517015936:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862657.080694:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862657.080706:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501685e00/0x9c5536ccf892fc8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345d0 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862657.080718:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862657.080737:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:2348:x1874709517015936:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 67us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862657.080743:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:1.0:1787862657.080756:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787862657.080762:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2348:x1874709517016192:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862657.080769:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862657.080779:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918200/0x9c5536ccf892fed9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3469b expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862657.080788:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862657.080819:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2348:x1874709517016192:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 56us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862657.080825:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:2.0:1787862657.086248:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517015808 00000100:00100000:2.0:1787862657.086275:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517015808 00000100:00100000:2.0:1787862657.086410:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:2.0:1787862657.086427:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+5:2345:x1874709517015808:12345-192.168.202.60@tcp:9:umount.0 00000020:00000080:2.0:1787862657.086476:0:6672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892ffc7 00000100:00080000:2.0:1787862657.086490:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9a651fe86000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787862657.086659:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1787862657.086894:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787862657.087384:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21567a16-68b5-41a8-a3f6-27f314a231da+2:2345:x1874709517015808:12345-192.168.202.60@tcp:9:umount.0 Request processed in 960us (7449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862657.087397:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 72 00010000:00010000:0.0:1787862657.094571:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862657.096613:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862657.097330:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517016576 00000100:00100000:2.0:1787862657.097346:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517016576 00000100:00100000:2.0:1787862657.097465:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:2.0:1787862657.097480:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+7:2345:x1874709517016576:12345-192.168.202.60@tcp:9:umount.0 00000020:00000080:2.0:1787862657.097543:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8930228 00000020:00010000:2.0:1787862657.097555:0:6671:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6526cc8000: total 0 00000100:00080000:2.0:1787862657.097562:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9a6526cca800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862657.097629:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1787862657.097782:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1787862657.098818:0:5804:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6526cc8000: total 0 00010000:00010000:1.0:1787862657.098883:0:5804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6526cc8000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787862657.098958:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171d7d2c/0x9c5536ccf8930c69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a3e expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862657.099003:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30323b7/0x9c5536ccf89305cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34870 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862657.099023:0:5804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6526cc8000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787862657.099038:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862657.099182:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862657.099186:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862657.099929:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21567a16-68b5-41a8-a3f6-27f314a231da+2:2345:x1874709517016576:12345-192.168.202.60@tcp:9:umount.0 Request processed in 2444us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862657.099973:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:1.0:1787862657.113284:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862657.113471:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517017600 00000100:00100000:0.0:1787862657.113485:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517017600 00000100:00100000:0.0:1787862657.113586:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 240 00000100:00100000:0.0:1787862657.113598:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+23:2345:x1874709517017600:12345-192.168.202.60@tcp:39:umount.0 00000020:00000080:0.0:1787862657.113657:0:5816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc63 00000020:00010000:0.0:1787862657.113697:0:5816:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a651f8d7000: total 0 00000100:00080000:0.0:1787862657.113705:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9a6509830800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787862657.113751:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787862657.114341:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21567a16-68b5-41a8-a3f6-27f314a231da+22:2345:x1874709517017600:12345-192.168.202.60@tcp:39:umount.0 Request processed in 742us (1072us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787862657.114352:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 240 00000020:00010000:2.0:1787862657.114705:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a651f8d7000: total 0 00010000:00010000:2.0:1787862657.114779:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a651f8d7000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1787862657.114842:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862657.114848:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862657.114859:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89304ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34823 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.114888:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862657.114890:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862657.114894:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919400/0x9c5536ccf89305a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34862 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.114909:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862657.114911:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862657.114915:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a654204e800/0x9c5536ccf892ff9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346c5 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.114932:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862657.114934:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862657.114938:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8930b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b349f1 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.114953:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862657.114956:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862657.114960:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8930c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a29 expref: 17 pid: 12008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.114997:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:2.0:1787862657.115000:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862657.115004:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d600/0x9c5536ccf893062d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3488c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115018:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6517c53800) 00010000:00010000:2.0:1787862657.115020:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862657.115024:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf892ff49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346b0 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115097:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862657.115101:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787862657.115105:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89305b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34869 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115119:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6517dfc900) 00010000:00010000:2.0:1787862657.115122:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787862657.115126:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c000/0x9c5536ccf8930c54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a37 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115143:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6507fe6300) 00010000:00010000:2.0:1787862657.115146:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787862657.115149:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918e00/0x9c5536ccf893057e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3485b expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115166:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862657.115168:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862657.115179:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8930649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34893 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115197:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862657.115199:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862657.115202:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6401b79200/0x9c5536ccf8930928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34965 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115217:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6516880e00) 00010000:00010000:2.0:1787862657.115220:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862657.115224:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893028a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34797 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115238:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862657.115240:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862657.115244:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf892ff2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b346a9 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862657.115255:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a651f8d7000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1787862657.115272:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862657.115275:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862657.115277:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862657.629662:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862658.274572:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862658.274656:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862658.274846:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517017856 00000100:00100000:0.0:1787862658.274861:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517017856 00000100:00100000:0.0:1787862658.274991:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 196 00000100:00100000:0.0:1787862658.275007:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09001ba1-03f5-4db1-a589-c226f7e46380+6:2347:x1874709517017856:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862658.275150:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:09001ba1-03f5-4db1-a589-c226f7e46380+6:2347:x1874709517017856:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 147us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862658.275158:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 196 00000100:00080000:1.0:1787862658.275604:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862658.275802:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517017728 00000100:00100000:3.0:1787862658.275811:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517017728 00000100:00100000:3.0:1787862658.275868:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 316 00000100:00100000:3.0:1787862658.275877:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2347:x1874709517017728:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862658.275959:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2347:x1874709517017728:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 83us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862658.275967:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 316 00000001:00100000:2.0:1787862658.326540:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:2.0:1787862658.326560:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a651fe84000/21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:0.0:1787862658.326742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651fe84000/21567a16-68b5-41a8-a3f6-27f314a231da for lustre-OST0001 00000020:00000080:0.0:1787862658.326837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651fe86000 for lustre-OST0001 00010000:00010000:0.0:1787862658.652328:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862658.716657:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526438528:0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.716760:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862658.716865:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787862658.716872:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526438400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.716900:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862658.716941:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526438912:0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.716970:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862658.717004:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438528 00000100:00100000:1.0:1787862658.717013:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438528 00000100:00100000:1.0:1787862658.717132:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438400 00000100:00100000:1.0:1787862658.717136:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438400 00000100:00100000:1.0:1787862658.717162:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787862658.717193:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526438528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.717266:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526438528:12345-0@lo:400:kworker.0 Request processed in 75us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862658.717276:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787862658.717296:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787862658.717302:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526438400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.717328:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526438400:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862658.717333:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1787862658.717357:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862658.717405:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526438400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.717418:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526438528:0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.717920:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526438272:0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.717987:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862658.718031:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526438784:0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.718088:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862658.718113:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862658.718120:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526438656:0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.718148:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862658.718182:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438912 00000100:00100000:0.0:1787862658.718187:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438912 00000100:00100000:0.0:1787862658.718229:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438656 00000100:00100000:0.0:1787862658.718233:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438656 00000100:00100000:0.0:1787862658.718254:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787862658.718261:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526438912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.718331:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526438912:12345-0@lo:400:kworker.0 Request processed in 70us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862658.718338:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787862658.718356:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787862658.718362:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.718395:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526438656:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862658.718402:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787862658.718422:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862658.718426:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862658.718452:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526438656:0@lo:400:kworker.0 00000100:00100000:3.0:1787862658.718655:0:12007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438784 00000100:00100000:3.0:1787862658.718661:0:12007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438784 00000100:00100000:3.0:1787862658.718704:0:12007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787862658.718712:0:12007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526438784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862658.718757:0:12007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526438784:12345-0@lo:400:kworker.0 Request processed in 47us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862658.718764:0:12007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1787862658.718783:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862658.718820:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526438784:0@lo:400:kworker.0 00000100:00100000:0.0:1787862658.718891:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526438912:0@lo:400:kworker.0 00000040:00080000:3.0:1787862658.719292:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787862658.719298:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862658.719718:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787862658.719726:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787862658.722463:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526438272 00000100:00100000:1.0:1787862658.723432:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526438272 00000100:00100000:1.0:1787862658.724700:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787862658.724727:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526438272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862658.724904:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526438272:12345-0@lo:400:kworker.0 Request processed in 190us (6916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862658.726286:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787862658.729551:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526438272:0@lo:400:kworker.0 00000100:00100000:3.0:1787862659.230280:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862659.230331:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862659.230448:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862659.230676:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439040 00000100:00100000:2.0:1787862659.230687:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439040 00000100:00100000:2.0:1787862659.230759:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862659.230770:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526439040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862659.230832:0:6674:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862659.230923:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526439040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862659.230931:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787862659.231078:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526439040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862659.677734:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787862659.825795:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:2.0:1787862659.825809:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a6526cc8000/21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:2.0:1787862659.825853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6526cc8000/21567a16-68b5-41a8-a3f6-27f314a231da for lustre-OST0000 00000020:00000080:2.0:1787862659.825925:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6526cca800 for lustre-OST0000 00000001:00100000:2.0:1787862659.841904:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 21567a16-68b5-41a8-a3f6-27f314a231da 00000001:00080000:2.0:1787862659.841936:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787862659.841968:0:5837:0:(genops.c:885:class_export_put()) final put ffff9a651f8d7000/21567a16-68b5-41a8-a3f6-27f314a231da 00000020:00000080:2.0:1787862659.841999:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651f8d7000/21567a16-68b5-41a8-a3f6-27f314a231da for lustre-MDT0000 00000020:00000080:2.0:1787862659.842095:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6509830800 for lustre-MDT0000 00000100:00100000:1.0:1787862659.932684:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862659.932795:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862659.938791:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862659.944876:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517018240 00000100:00100000:2.0:1787862659.944902:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517018240 00000100:00100000:2.0:1787862659.945020:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517017984 00000100:00100000:2.0:1787862659.945025:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517017984 00000100:00100000:2.0:1787862659.945065:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517018112 00000100:00100000:2.0:1787862659.945069:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517018112 00000100:00100000:2.0:1787862659.945100:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787862659.945112:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65099f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+12:2348:x1874709517018240:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862659.945134:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862659.945160:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919800/0x9c5536ccf892fed2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34694 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862659.945182:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862659.946493:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65099f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+11:2348:x1874709517018240:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 1372us (13812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862659.946509:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787862659.946575:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862659.946585:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+10:2346:x1874709517017984:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862659.946602:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862659.946622:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfde00/0x9c5536ccf892fd35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345e5 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862659.946644:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862659.947143:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+9:2346:x1874709517017984:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 559us (14346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862659.947149:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862659.947164:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:2.0:1787862659.947170:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+8:2346:x1874709517018112:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862659.947183:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862659.947194:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501685000/0x9c5536ccf892fd3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b3460f expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862659.947206:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862659.947220:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f669f76-38ef-4f30-8d78-9f530fa777ac+7:2346:x1874709517018112:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 51us (8465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862659.947225:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1787862659.955709:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862659.955964:0:12008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517018496 00000100:00100000:1.0:1787862659.955979:0:12008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517018496 00000100:00100000:1.0:1787862659.956329:0:12008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 241 00000100:00100000:1.0:1787862659.956372:0:12008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+6:2345:x1874709517018496:12345-192.168.202.60@tcp:39:umount.0 00000020:00000080:1.0:1787862659.956672:0:12008:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fd4a 00000020:00010000:1.0:1787862659.956686:0:12008:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6537eca000: total 0 00000100:00080000:1.0:1787862659.956693:0:12008:0:(import.c:65:import_set_state_nolock()) ffff9a6537ecd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787862659.956725:0:12008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787862659.958706:0:12008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:09001ba1-03f5-4db1-a589-c226f7e46380+5:2345:x1874709517018496:12345-192.168.202.60@tcp:39:umount.0 Request processed in 2321us (2998us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787862659.958729:0:12008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 241 00000020:00010000:0.0:1787862659.960563:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6537eca000: total 0 00010000:00010000:0.0:1787862659.960657:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6537eca000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787862659.960706:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6517c53c00) 00010000:00010000:0.0:1787862659.960712:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862659.960727:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8930c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a45 expref: 4 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862659.960760:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6537eca000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787862659.960771:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862659.960786:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862659.960789:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862659.999354:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862659.999551:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517018752 00000100:00100000:2.0:1787862659.999565:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517018752 00000100:00100000:2.0:1787862659.999638:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 318 00000100:00100000:2.0:1787862659.999648:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+7:2345:x1874709517018752:12345-192.168.202.60@tcp:251:umount.0 00000020:00000080:2.0:1787862659.999709:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc40 00000020:00010000:2.0:1787862659.999719:0:5809:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6537e6e800: total 0 00000100:00080000:2.0:1787862659.999742:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9a6537e69000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787862659.999921:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f669f76-38ef-4f30-8d78-9f530fa777ac+3:2345:x1874709517018752:12345-192.168.202.60@tcp:251:umount.0 Request processed in 273us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862659.999931:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 318 00000020:00010000:0.0:1787862660.007357:0:7622:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6537e6e800: total 0 00010000:00010000:0.0:1787862660.007399:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862660.007478:0:7622:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6537e6e800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787862660.007547:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af44000/0x9c5536ccf892fc94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b345d7 expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862660.007573:0:7622:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6537e6e800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787862660.007584:0:7622:0:(genops.c:885:class_export_put()) final put ffff9a6537e6e800/0f669f76-38ef-4f30-8d78-9f530fa777ac 00010000:00010000:0.0:1787862660.007608:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862660.007610:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862660.007612:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787862660.007661:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537e6e800/0f669f76-38ef-4f30-8d78-9f530fa777ac for MGS 00000020:00000080:2.0:1787862660.007721:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6537e69000 for MGS 00010000:00010000:3.0:1787862660.716073:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862660.779822:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526439168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862660.779936:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862660.780426:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439168 00000100:00100000:3.0:1787862660.780437:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439168 00000100:00100000:3.0:1787862660.780532:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787862660.780545:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526439168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862660.780594:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862660.780664:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526439168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862660.780673:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787862660.780815:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862660.780979:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526439168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862661.725315:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787862662.348770:0:12913:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787862662.374257:0:12913:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787862662.374313:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.374337:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.374343:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.374349:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.374370:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862662.374375:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787862662.374400:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787862662.374406:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787862662.374422:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787862662.374602:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787862662.374666:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526439296:0@lo:39:umount.0 00000100:00100000:1.0:1787862662.374767:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862662.374854:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439296 00000100:00100000:1.0:1787862662.374861:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439296 00000100:00100000:1.0:1787862662.374913:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787862662.374925:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653416cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874709526439296:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787862662.374960:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fa4f 00000100:00080000:1.0:1787862662.374969:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9a6509836800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787862662.375023:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653416cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3280:x1874709526439296:12345-0@lo:39:umount.0 Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.375030:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787862662.375068:0:5815:0:(genops.c:885:class_export_put()) final put ffff9a6509833800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787862662.375090:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862662.375097:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.375105:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a650af45c00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862662.375109:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.375118:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862662.375126:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862662.375132:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862662.375143:0:7622:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787862662.375146:0:7622:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787862662.375179:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.375184:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862662.375440:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.375506:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af45c00/0x9c5536ccf892fcd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fcda expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.375521:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.375523:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.375524:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862662.375536:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526439424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862662.375565:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787862662.375614:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787862662.375622:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526439296:0@lo:39:umount.0 00000100:00080000:1.0:1787862662.375642:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787862662.375644:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787862662.375647:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787862662.376312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6509833800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1787862662.376562:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439424 00000100:00100000:2.0:1787862662.376571:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439424 00000100:00100000:2.0:1787862662.376622:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862662.376629:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401861680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3284:x1874709526439424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862662.376642:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862662.376660:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919c00/0x9c5536ccf892fcda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fcd3 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862662.376675:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862662.376733:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401861680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3284:x1874709526439424:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862662.376741:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862662.376792:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526439424:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787862662.377067:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6509836800 for lustre-MDT0000 00010000:00010000:1.0:1787862662.380128:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380151:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380160:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380183:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380224:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862662.380232:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380239:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380247:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380252:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380269:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787862662.380306:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862662.380312:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380318:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862662.380321:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380329:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862662.380334:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862662.380343:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862662.380346:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787862662.380388:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380392:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862662.380429:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.380437:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918800/0x9c5536ccf892fce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fce8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862662.380955:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862662.380961:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862662.380967:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862662.380969:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862662.380975:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862662.380979:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862662.380982:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787862662.380984:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787862662.380985:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787862662.381003:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862662.381006:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862662.381017:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862662.381022:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfd600/0x9c5536ccf892fbfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fc01 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862662.381140:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862662.381143:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862662.381144:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862662.381618:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862662.381720:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526439552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862662.381824:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862662.381918:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862662.381925:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526439680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862662.381951:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862662.382008:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382011:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382012:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382031:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382038:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382058:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382063:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382075:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862662.382081:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862662.382093:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382098:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204fe00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862662.382100:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382107:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862662.382114:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862662.382119:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787862662.382121:0:7622:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787862662.382124:0:7622:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787862662.382162:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382168:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862662.382182:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382314:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a654204fe00/0x9c5536ccf892fefc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892ff03 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382330:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382331:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382332:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382342:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382362:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382367:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382371:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382380:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787862662.382382:0:12913:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787862662.382385:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1787862662.382421:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862662.382425:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382431:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6500030000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862662.382434:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382441:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862662.382458:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862662.382465:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862662.382467:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787862662.382468:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787862662.382486:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382490:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862662.382495:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382499:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6500030000/0x9c5536ccf892f9ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892f9b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.382509:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382510:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.382511:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787862662.382523:0:12913:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787862662.382526:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787862662.382531:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787862662.382536:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787862662.382541:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a651c990000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787862662.382546:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6527d3c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787862662.382553:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a6537eca000 09001ba1-03f5-4db1-a589-c226f7e46380 192.168.202.60@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787862662.382557:0:12913:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a65401cb490) has exports, disconnecting them 00000020:00080000:1.0:1787862662.382560:0:12913:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a651c990000), last request at 1787862658 00000020:00000080:1.0:1787862662.382567:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fbc2 00000100:00080000:1.0:1787862662.382583:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9a65402fa800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787862662.382625:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a651c990000): rc 0 00000020:00000080:1.0:1787862662.382627:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a651c990000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787862662.382636:0:12913:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6527d3c800), last request at 1787862658 00000020:00000080:1.0:1787862662.382639:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892faf7 00000100:00080000:1.0:1787862662.382642:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9a6527d39000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787862662.382655:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787862662.382660:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6527d3c800): rc 0 00000020:00000080:1.0:1787862662.382662:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6527d3c800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787862662.382669:0:12913:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf1503b1fae0 00000100:00080000:1.0:1787862662.382692:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787862662.382694:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787862662.382705:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787862662.382779:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787862662.382808:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9a6403293800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787862662.382820:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787862662.382822:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787862662.382838:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787862662.382912:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526440064:0@lo:9:umount.0 00000100:00100000:1.0:1787862662.382959:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787862662.382997:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787862662.383005:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9a65403ab800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787862662.383016:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526440192:0@lo:9:umount.0 00000100:00100000:1.0:1787862662.383033:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862662.383079:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440064 00000100:00100000:1.0:1787862662.383086:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440064 00000100:00100000:1.0:1787862662.383143:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440192 00000100:00100000:1.0:1787862662.383146:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440192 00000100:00100000:1.0:1787862662.383169:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862662.383178:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874709526440064:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787862662.383218:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fb44 00000100:00080000:1.0:1787862662.383225:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a6507b12800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787862662.383262:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787862662.383621:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3280:x1874709526440064:12345-0@lo:9:umount.0 Request processed in 443us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.383637:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862662.383652:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862662.383658:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874709526440192:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787862662.383669:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc2b 00000100:00080000:1.0:1787862662.383674:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9a651f8d5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787862662.383690:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787862662.383894:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3280:x1874709526440192:12345-0@lo:9:umount.0 Request processed in 235us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.383902:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787862662.383925:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862662.383931:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787862662.383944:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862662.383951:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862662.383982:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65403ab800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787862662.383987:0:3280:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787862662.383988:0:3280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787862662.383991:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526440192:0@lo:9:umount.0 00000100:00080000:1.0:1787862662.383999:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6403293800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787862662.384001:0:3280:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787862662.384002:0:3280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787862662.384004:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526440064:0@lo:9:umount.0 00000020:00080000:1.0:1787862662.384069:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a65401cb490) has no exports 00010000:00010000:2.0:1787862662.384597:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862662.384624:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526439808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862662.384666:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526439936:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787862662.386974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c990000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787862662.387097:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6527d3c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787862662.387139:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65402fa800 for lustre-MDT0000 00000020:00000080:2.0:1787862662.387144:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6527d39000 for lustre-MDT0000 00000100:00100000:0.0:1787862662.394991:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439552 00000100:00100000:0.0:1787862662.395016:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439552 00000100:00100000:1.0:1787862662.395639:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439680 00000100:00100000:1.0:1787862662.395649:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439680 00000100:00100000:1.0:1787862662.395686:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862662.396014:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6512571850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+19:3281:x1874709526439552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862662.396290:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862662.396347:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45400/0x9c5536ccf892fce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fce1 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.396372:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862662.396970:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6512571850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+18:3281:x1874709526439552:12345-0@lo:103:ldlm_bl.0 Request processed in 1188us (15061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.396983:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862662.397098:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862662.397112:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3281:x1874709526439680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862662.397129:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862662.397147:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45a00/0x9c5536ccf892fc01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fbfa expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.397164:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862662.397576:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862662.397695:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862662.397856:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3281:x1874709526439680:12345-0@lo:103:ldlm_bl.0 Request processed in 749us (15903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.397867:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787862662.397968:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439936 00000100:00100000:1.0:1787862662.397979:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439936 00000100:00100000:1.0:1787862662.398022:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526439808 00000100:00100000:1.0:1787862662.398025:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526439808 00000100:00100000:1.0:1787862662.398107:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862662.398117:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+17:3284:x1874709526439936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862662.398131:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862662.398146:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a650af45e00/0x9c5536ccf892f9b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892f9ae expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.398390:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862662.398606:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+16:3284:x1874709526439936:12345-0@lo:103:ldlm_bl.0 Request processed in 491us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.398640:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862662.398664:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862662.398671:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+15:3283:x1874709526439808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862662.398682:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862662.398695:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501684600/0x9c5536ccf892ff03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fefc expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862662.398716:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862662.398771:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3283:x1874709526439808:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862662.398779:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862662.398830:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526439808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862662.401185:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43a6d3ac-1408-47c4-9e06-195b8e037a27:3284:1874709526439936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862662.408297:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526439680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862662.408362:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653416f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526439552:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787862662.414103:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a65401cb490) has no exports 00000020:00000080:2.0:1787862662.514395:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fa09 00000020:00000080:2.0:1787862662.514413:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6526c7c800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787862662.514438:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787862662.514498:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6526c7c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787862662.514555:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787862662.514571:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787862662.514577:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a65401c9a48) has no exports 00000020:00000080:3.0:1787862662.525108:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fa02 00000020:00000080:3.0:1787862662.525129:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a653e483000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787862662.525293:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a653e483000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787862662.525819:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862662.525836:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787862662.525841:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65401d4000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787862662.525844:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65401d4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787862662.525865:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787862662.748961:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787862663.417718:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787862663.417739:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a651f8d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787862663.418548:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651f8d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787862663.418611:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651f8d5000 for lustre-OST0001 00010000:00010000:1.0:1787862663.773620:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862663.841411:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526440320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862663.841502:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862663.841622:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440320 00000100:00100000:1.0:1787862663.841629:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440320 00000100:00100000:1.0:1787862663.841690:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787862663.841701:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3281:x1874709526440320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862663.841792:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526440448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862663.841827:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862663.841895:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440448 00000100:00100000:0.0:1787862663.841899:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440448 00000100:00100000:0.0:1787862663.841927:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787862663.841931:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1874709526440448:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787862663.841938:0:5817:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787862663.841967:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1874709526440448:12345-0@lo:400:kworker.0 Request processed in 34us (139us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787862663.841974:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1787862663.842007:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787862663.842012:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787862663.842015:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787862663.844433:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6517e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43a6d3ac-1408-47c4-9e06-195b8e037a27+14:3281:x1874709526440320:12345-0@lo:400:kworker.0 Request processed in 2722us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862663.844449:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787862663.844701:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787862663.844762:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862663.844864:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440576 00000100:00100000:2.0:1787862663.844871:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440576 00000100:00100000:2.0:1787862663.844921:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787862663.844928:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3283:x1874709526440576:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787862663.844936:0:7147:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787862663.844981:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3283:x1874709526440576:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787862663.844987:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787862663.845019:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787862663.845024:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787862663.845028:0:3283:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787862663.845034:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787862663.845062:0:3283:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 165 00000100:00080000:2.0:1787862663.845068:0:3283:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a651c994800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862663.845090:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64019f2580 x1874709526440704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862663.845108:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787862663.845324:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526440704:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787862663.845354:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862663.845476:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440704 00000100:00100000:2.0:1787862663.845481:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440704 00000100:00100000:2.0:1787862663.845512:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787862663.845517:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526440704:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787862663.845533:0:5815:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787862663.845653:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526440320:0@lo:400:kworker.0 00000100:00080000:0.0:1787862663.854086:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787862663.854098:0:3282:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 144 00000100:00080000:0.0:1787862663.854108:0:3282:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a651c991800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787862663.854155:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6534149680 x1874709526440832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862663.854225:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526440832:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787862663.854309:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862663.855215:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526440448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862663.855277:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526440832 00000100:00100000:0.0:1787862663.855296:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526440832 00000100:00100000:0.0:1787862663.855347:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787862663.855356:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526440832:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787862663.855375:0:5817:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787862663.860482:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526440832:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 5115us (6162us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787862663.860501:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787862663.861121:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862663.861127:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787862663.861131:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526440832:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787862663.865303:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526440704:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 19776us (19940us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787862663.865318:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787862663.865614:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862663.865620:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787862663.865624:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526440704:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1787862664.801568:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787862664.936319:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 09001ba1-03f5-4db1-a589-c226f7e46380 00000001:00080000:2.0:1787862664.936336:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787862664.936342:0:5837:0:(genops.c:885:class_export_put()) final put ffff9a6537eca000/09001ba1-03f5-4db1-a589-c226f7e46380 00000020:00000080:2.0:1787862664.936366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6537eca000/09001ba1-03f5-4db1-a589-c226f7e46380 for lustre-MDT0000 00000020:00000080:2.0:1787862664.936419:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6537ecd800 for lustre-MDT0000 00000001:00100000:0.0:1787862664.953340:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787862664.953355:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a6507b13800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787862664.953417:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6507b13800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787862664.953508:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6507b12800 for lustre-OST0000 00010000:00010000:2.0:1787862665.820375:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862666.852673:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862667.869211:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787862668.572282:0:12913:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a6512576060 - data ffff9a653c665e58/ffff9a6537e2d000 00000020:01000000:2.0:1787862668.572473:0:12913:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a65094ebd80 - data ffff9a6539ffee58/ffff9a65407a3400 00000001:00000004:2.0:1787862668.585258:0:12913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787862668.818730:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787862668.818743:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787862668.818991:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787862668.818995:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787862668.821508:0:6936:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787862668.821519:0:6936:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787862668.821533:0:6936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787862668.822827:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787862668.822839:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1787862668.822867:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787862668.822871:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787862668.823267:0:7988:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787862668.823273:0:7988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787862668.823284:0:7988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787862668.934883:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f9d1 00000020:00000080:0.0:1787862668.934900:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65401d4800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787862668.936273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65401d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787862668.941994:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f9e6 00000020:00000080:0.0:1787862668.942011:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a650741f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787862668.942033:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787862668.942058:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862668.942081:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787862668.942085:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a65401cced8) has no exports 00000004:01000000:0.0:1787862668.942340:0:12913:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787862668.942352:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc24 00000020:00000080:0.0:1787862668.942360:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65403a9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787862668.942367:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787862668.942372:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862668.942379:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787862668.942383:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a6526ce4ed8) has no exports 00000020:00000080:0.0:1787862668.942406:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fc1d 00000020:00000080:0.0:1787862668.942416:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65403ac000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787862668.942572:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650741f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787862668.942582:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65403a9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787862668.942589:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65403ac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787862668.945538:0:12913:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787862668.945548:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787862668.945552:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787862668.945560:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787862668.945562:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787862668.945670:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862668.945682:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787862668.945699:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fb3d 00000020:00000080:0.0:1787862668.945710:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6403291800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787862668.945795:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a65403ab800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787862668.945805:0:8:0:(genops.c:885:class_export_put()) final put ffff9a6504d5d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787862668.945807:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6504d5d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787862668.945830:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787862668.946356:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787862668.946365:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862668.946373:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787862668.946377:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a640328ced8) has no exports 00000020:00000080:0.0:1787862668.946385:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fb36 00000020:00000080:0.0:1787862668.946400:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6403290000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787862668.946473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6403291800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787862668.946734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6403290000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787862668.947342:0:12913:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787862668.947347:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787862668.947351:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787862668.947356:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787862668.947359:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787862668.947501:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862668.947520:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787862668.947555:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862668.947559:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787862668.947564:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65401d7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787862668.947566:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65401d7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787862668.947573:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787862668.947744:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f9ed 00000020:00000080:0.0:1787862668.947750:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a650741d800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787862668.947851:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6403293800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787862668.947861:0:8:0:(genops.c:885:class_export_put()) final put ffff9a65402fb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787862668.947876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65402fb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787862668.947881:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787862668.948304:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787862668.948311:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862668.948316:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787862668.948320:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a653aa29a48) has no exports 00000020:00000080:0.0:1787862668.948343:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862668.948347:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787862668.948351:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f9f4 00000020:00000080:0.0:1787862668.948356:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a650741a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787862668.948372:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650741d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787862668.948376:0:8:0:(genops.c:885:class_export_put()) final put ffff9a650741e800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787862668.948379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650741e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787862668.948383:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787862668.948750:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a65091a1800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787862668.948754:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a65091a1800 3 00000020:01000004:0.0:1787862668.948758:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a65091a1800 from lustre-MDT0000 00000020:00000080:0.0:1787862668.948781:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862668.948787:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787862668.948790:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65401d1800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787862668.948792:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65401d1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787862668.948801:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787862668.948840:0:12913:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787862668.948844:0:12913:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787862668.948848:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787862668.948851:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862668.948855:0:12913:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787862668.948862:0:12913:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a651c994000 43a6d3ac-1408-47c4-9e06-195b8e037a27 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787862668.948882:0:12913:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a651c9d3490) has exports, disconnecting them 00000020:00080000:0.0:1787862668.948887:0:12913:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a651c994000), last request at 1787862400 00000020:00000080:0.0:1787862668.948916:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f992 00000020:00010000:0.0:1787862668.948921:0:12913:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a651c994000: total 1 00000100:00080000:0.0:1787862668.948927:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9a651c992000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787862668.948953:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a651c994000): rc 0 00000020:00080000:0.0:1787862668.948957:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a651c9d3490) has no exports 00000100:00100000:0.0:1787862668.949019:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a6512485200:5809] 1 exiting: rc = 0 00000020:00010000:3.0:1787862668.949209:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a651c994000: total 1 00010000:00010000:3.0:1787862668.949246:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a651c994000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787862668.949280:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfd800/0x9c5536ccf892fee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fee0 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949307:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918400/0x9c5536ccf892fcf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fcef expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949320:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a654204f200/0x9c5536ccf892fef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892feee expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949337:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6500030600/0x9c5536ccf892faaa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892faa3 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949352:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919200/0x9c5536ccf892fca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fc9b expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949378:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919e00/0x9c5536ccf892fcb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fca9 expref: 4 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949403:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6501685a00/0x9c5536ccf892fcbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fcb7 expref: 3 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949417:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918c00/0x9c5536ccf892fccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c5536ccf892fcc5 expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862668.949440:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a651c994000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787862668.949479:0:5803:0:(genops.c:885:class_export_put()) final put ffff9a651c994000/43a6d3ac-1408-47c4-9e06-195b8e037a27 00000020:00000080:1.0:1787862668.949919:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650741a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787862668.949954:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a6509c29000:5810] 2 exiting: rc = 0 00000100:00100000:1.0:1787862668.950034:0:5808:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a6509c29a00:5808] 0 exiting: rc = 1 00000100:00100000:0.0:1787862668.950184:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950193:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950200:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950219:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950226:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950231:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950239:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950246:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950252:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950257:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950264:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950283:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950290:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950297:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950304:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950310:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950316:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950323:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950329:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950335:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950342:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950348:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950354:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950360:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950366:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950372:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950379:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950384:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1787862668.950532:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862668.950536:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862668.950538:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862668.950588:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950596:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950602:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950608:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950614:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950620:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950625:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950631:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950636:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950643:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950658:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950665:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950671:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950677:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950682:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950688:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950705:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950710:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950715:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950720:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950725:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950730:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950736:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950742:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950749:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950755:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950760:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950767:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950772:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950778:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950783:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950789:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950794:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950800:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950806:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862668.950820:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787862668.951232:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787862668.951235:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1787862668.952326:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c994000/43a6d3ac-1408-47c4-9e06-195b8e037a27 for MGS 00000020:00000080:1.0:1787862668.952534:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c992000 for MGS 00000020:01000000:0.0:1787862668.952582:0:12913:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a653402f7e0 - data ffff9a653e855a20/ffff9a653dacb400 00000020:01000000:1.0:1787862668.955561:0:12913:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a6509a0cc00 - data ffff9a650f05ca20/ffff9a651238b800 00000020:00000080:1.0:1787862668.958550:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f976 00000020:00000080:1.0:1787862668.958562:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6506109800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787862668.958573:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a65091a1800 from MGS, refs=2 00000020:01000004:1.0:1787862668.958577:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a65091a1800 2 00000020:01000004:1.0:1787862668.958580:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a65091a1800 from MGS 00000020:00000080:1.0:1787862668.958604:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787862668.958613:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787862668.958616:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a650610d000/MGS 00000020:00000080:1.0:1787862668.958619:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650610d000/MGS for MGS 00000020:01000000:1.0:1787862668.958728:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787862668.958842:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787862668.958848:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787862668.958865:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787862668.958873:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a6526c78800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787862668.960778:0:12913:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9a651c9d0000) has exports, disconnecting them 00000020:00080000:1.0:1787862668.960787:0:12913:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a6526c78800), last request at 1787862401 00000020:00000080:1.0:1787862668.960792:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fa41 00000020:00080000:1.0:1787862668.960818:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6526c78800): rc 0 00000020:00000080:1.0:1787862668.960825:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6526c78800/lustre-MDT0000-lwp-MDT0000 00000100:00080000:0.0:1787862668.961852:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787862668.961858:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787862668.961862:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787862668.961869:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 389 00000100:00080000:0.0:1787862668.961875:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787862668.961881:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a651c991800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787862668.961904:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a653414b840 x1874709526441088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787862668.961922:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787862668.961926:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787862668.961928:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787862668.961931:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 389 00000100:00080000:0.0:1787862668.961933:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787862668.961937:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a651c994800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787862668.961949:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6534149680 x1874709526441216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1787862668.961965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6506109800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1787862668.962495:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862668.962530:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526440960:0@lo:400:kworker.0 00000400:00000100:2.0:1787862668.962618:0:3283:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874709526440960 offset 0 length 224: 4 00000020:00000080:0.0:1787862668.963627:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6526c78800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:0.0:1787862668.964160:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653414b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526441088:0@lo:38:kworker.0 00000100:00100000:0.0:1787862668.964243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862668.964294:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526441216:0@lo:38:kworker.0 00000100:00100000:0.0:1787862668.964343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862668.964483:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526441088 00000100:00100000:3.0:1787862668.964493:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526441088 00000100:00100000:3.0:1787862668.964535:0:7147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526441216 00000100:00100000:3.0:1787862668.964538:0:7147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526441216 00000100:00100000:3.0:1787862668.964558:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787862668.964565:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874709526441088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787862668.964585:0:7147:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787862668.964631:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874709526441088:12345-0@lo:38:kworker.0 Request processed in 64us (387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787862668.964638:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787862668.964665:0:7147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787862668.964670:0:7147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874709526441216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787862668.964677:0:7147:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787862668.964722:0:7147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874709526441216:12345-0@lo:38:kworker.0 Request processed in 51us (378us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787862668.964728:0:7147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1787862668.964902:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862668.964907:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787862668.964911:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653414b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526441088:0@lo:38:kworker.0 00000100:00080000:0.0:1787862668.964920:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862668.964923:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787862668.964926:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526441216:0@lo:38:kworker.0 00010000:01000000:0.0:1787862668.972156:0:12913:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787862668.972167:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787862668.972172:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787862668.972180:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787862668.972385:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862668.972477:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a653e4b5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787862668.972515:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787862668.972522:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a65331d4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787862668.972525:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65331d4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787862668.972532:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787862668.972598:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a65091a1800 1 00000020:00000080:0.0:1787862668.972605:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f968 00000020:00000080:0.0:1787862668.972617:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a650610b000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787862668.972784:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787862668.972791:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862668.972795:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787862668.972799:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a653aa2ced8) has no exports 00000020:00000080:3.0:1787862668.974209:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a650610b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787862669.067755:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862669.067965:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787862669.067973:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a6502fe1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787862669.067978:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6502fe1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787862669.067988:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787862669.077204:0:12913:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6511517000 00000020:01000000:0.0:1787862669.077244:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787862669.077255:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862669.077262:0:12913:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787862669.077268:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a651c9d1a48) has no exports 00000100:00100000:0.0:1787862669.077466:0:5817:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a65095a1c00:5817] 2 exiting: rc = 0 00000100:00100000:0.0:1787862669.077587:0:12007:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a6534068c00:12007] 4 exiting: rc = 0 00000100:00100000:0.0:1787862669.077665:0:12008:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9a651ca8f800:12008] 5 exiting: rc = 0 00000100:00100000:2.0:1787862669.078678:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a6509eb6a00:5815] 0 exiting: rc = 1 00000100:00100000:3.0:1787862669.090131:0:7147:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a6401839a00:7147] 3 exiting: rc = 0 00000100:00100000:3.0:1787862669.091273:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a65095a1000:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1787862669.092754:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092765:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092770:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092776:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092787:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092793:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092807:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092813:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092819:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092825:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092831:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092837:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092843:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092854:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092859:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092865:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092870:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092875:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092882:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092887:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092893:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092898:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092904:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092909:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092914:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092933:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092938:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092943:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092948:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092953:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092958:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092964:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092969:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092975:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092980:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092986:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092994:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.092999:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093004:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093009:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093014:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093019:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093024:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093029:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093033:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093039:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093982:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093988:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093994:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.093998:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.094003:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.094028:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.094034:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.097964:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.097994:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098001:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098008:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098015:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098021:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098028:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098077:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098083:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862669.098089:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.107852:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a6511733c00:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1787862669.110189:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a6511732600:5819] 1 exiting: rc = 0 00000100:00100000:3.0:1787862669.110370:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110379:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110385:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110402:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110408:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110414:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110420:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110425:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110431:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110437:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110443:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110450:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110459:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110465:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110470:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110475:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110480:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110484:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110489:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110494:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110498:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110503:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110507:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110512:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110533:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110538:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110543:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110548:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110553:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110557:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110563:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110568:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110573:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110578:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110582:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110587:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110591:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110595:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110600:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110605:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110609:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110614:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110618:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110623:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110628:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110632:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110638:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110643:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110648:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110653:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110659:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110664:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110671:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110677:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110682:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110687:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110703:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110709:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110715:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110728:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110733:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110738:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110743:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.110748:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862669.111538:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a651c25b600:5821] 1 exiting: rc = 0 00000100:00100000:2.0:1787862669.111933:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a651c25b400:5820] 0 exiting: rc = 1 00000100:00100000:3.0:1787862669.118363:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118384:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118608:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118615:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118622:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118628:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118635:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118655:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118664:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118670:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118678:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118685:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118703:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118710:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118717:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118723:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118729:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118736:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118744:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118768:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118775:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118788:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118794:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118803:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118810:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118816:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118822:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118893:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118899:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118919:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118941:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118949:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118955:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118962:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118968:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118974:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118980:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118986:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118992:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.118998:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119129:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119141:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119171:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119178:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119184:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119191:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119197:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119208:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119214:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119220:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119226:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119232:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119238:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119245:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119265:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119273:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119278:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119285:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119290:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119296:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119301:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119309:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.119323:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862669.134777:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a651c25ac00:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1787862669.135603:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a651c25bc00:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1787862669.135703:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135712:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135718:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135723:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135728:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135735:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135740:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135745:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135750:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135755:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135760:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135766:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135771:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135776:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135780:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135785:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135790:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135795:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135800:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135805:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135810:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135815:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135820:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135825:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135830:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135836:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135841:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135845:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135851:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135856:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.135860:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136314:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136325:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136330:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136335:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136349:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136354:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136359:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136364:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136369:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136374:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136380:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136385:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136460:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136466:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136471:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136477:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136482:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136487:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136492:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136498:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136503:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136508:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136513:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136519:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136524:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136528:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136603:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136610:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136615:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136621:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136626:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136631:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.136637:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862669.138762:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a651c25ba00:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1787862669.139153:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a651c25a800:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1787862669.139229:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139236:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139242:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139246:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139252:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139271:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139276:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139281:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139286:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139292:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139297:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139302:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139306:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139311:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139317:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139323:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139329:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139333:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139339:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139343:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139348:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139352:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139357:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139361:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139367:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139371:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139377:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.139382:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140213:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140227:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140231:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140236:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140241:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140245:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140250:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140254:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140258:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140263:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140268:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140272:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140287:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140292:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140296:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140301:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140306:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140311:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140316:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140321:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140325:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140330:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140335:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140340:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140344:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140349:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140354:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140359:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140364:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140369:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140373:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140379:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140384:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140458:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140464:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.140468:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862669.141339:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a651c25a400:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1787862669.142836:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a651c15f800:5827] 1 exiting: rc = 0 00000100:00100000:3.0:1787862669.143361:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143370:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143376:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143382:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143398:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143404:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143409:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143413:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143418:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143423:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143428:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143453:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143458:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143465:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143470:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143475:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143479:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143484:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143489:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143494:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143499:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143504:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143509:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143514:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143519:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143523:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143528:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143682:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143716:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143721:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143726:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143732:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143736:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143741:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143747:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143752:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143758:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143763:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143768:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143773:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143778:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143788:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143793:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143799:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143804:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143818:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143823:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143828:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143833:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143838:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143843:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143848:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143852:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143857:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143861:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143865:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143869:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143874:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143878:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143883:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143902:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143908:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.143913:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787862669.147061:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a65331ca400:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1787862669.148487:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a653314e800:5830] 2 exiting: rc = 0 00000100:00100000:2.0:1787862669.148554:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a65331cbe00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1787862669.149197:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149213:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149275:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149287:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149293:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149301:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149311:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149319:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149326:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149333:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149339:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149345:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149381:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149464:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149471:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149476:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149495:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149500:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149506:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149511:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149517:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149524:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.149529:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150794:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150803:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150809:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150815:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150820:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150827:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150834:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150840:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150845:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150850:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150856:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150863:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150887:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150923:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150931:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150937:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150944:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150950:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150957:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150964:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150970:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150976:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150982:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.150988:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151130:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151140:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151146:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151152:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151244:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151251:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151256:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151262:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151268:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151279:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151285:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151290:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151296:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151302:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151306:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151312:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862669.151318:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787862669.163658:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862669.163671:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787862669.163677:0:12913:0:(genops.c:885:class_export_put()) final put ffff9a651c997800/MDS_uuid 00000020:00000080:3.0:1787862669.163683:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c997800/MDS_uuid for MDS 00000020:01000000:3.0:1787862669.163704:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787862669.163887:0:12913:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787862669.279236:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862670.301577:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862671.328965:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862672.349014:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787862673.064708:0:13067:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787862673.081246:0:13067:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787862673.081298:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.081314:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.081322:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.081329:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.081362:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787862673.081368:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787862673.081391:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787862673.081408:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787862673.081416:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787862673.081424:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9a651c991800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787862673.081429:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787862673.081431:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787862673.081435:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787862673.082263:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862673.082276:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862673.082286:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfdc00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862673.082290:0:7623:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862673.082301:0:7623:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862673.082308:0:7623:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862673.082314:0:7623:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787862673.082316:0:7623:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787862673.082319:0:7623:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787862673.082416:0:7623:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862673.082423:0:7623:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862673.082458:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862673.082466:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfdc00/0x9c5536ccf892fcb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fcbe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862673.082494:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862673.082496:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862673.082497:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862673.082616:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526441344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862673.082705:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862673.083491:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526441344 00000100:00100000:2.0:1787862673.083500:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526441344 00000100:00100000:2.0:1787862673.083546:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787862673.083553:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a42d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3281:x1874709526441344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787862673.083560:0:5802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787862673 with bad export cookie 11264970296908773778 00010000:00010000:1.0:1787862673.084638:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084663:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084671:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084677:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084701:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862673.084708:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084716:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084722:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084727:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862673.084757:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787862673.084763:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787862673.084790:0:13067:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787862673.084795:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787862673.084800:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787862673.084805:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787862673.084809:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a6526ce0000) has no exports 00000020:00080000:1.0:1787862673.085013:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a6526ce0000) has no exports 00010000:00010000:0.0:1787862673.085683:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862673.085694:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085704:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6501684000 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862673.085709:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085718:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862673.085726:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862673.085732:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787862673.085734:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787862673.085737:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787862673.085779:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085786:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862673.085813:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085821:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6501684000/0x9c5536ccf892fcc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fccc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085847:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862673.085851:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085856:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918a00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:0.0:1787862673.085860:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085866:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787862673.085872:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862673.085877:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787862673.085879:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787862673.085881:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787862673.085895:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085901:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787862673.085916:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085923:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf892feee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c5536ccf892fef5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862673.085932:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862673.085933:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862673.085941:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862673.085960:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526441472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862673.086027:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787862673.086441:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862673.087464:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526441600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862673.087523:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862673.087570:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526441472 00000100:00100000:0.0:1787862673.087577:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526441472 00000100:00100000:0.0:1787862673.087615:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526441600 00000100:00100000:0.0:1787862673.087619:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526441600 00000100:00100000:0.0:1787862673.087632:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862673.087640:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3282:x1874709526441472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787862673.087646:0:5801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787862673 with bad export cookie 11264970296908773778 00000100:00100000:0.0:1787862673.087706:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3282:x1874709526441472:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1680us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787862673.087713:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862673.087729:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787862673.087733:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3283:x1874709526441600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787862673.087736:0:5801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787862673 with bad export cookie 11264970296908773778 00000100:00100000:0.0:1787862673.087762:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3283:x1874709526441600:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (238us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787862673.087768:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787862673.087797:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787862673.087801:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9a651c1b4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787862673.087806:0:3282:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787862673.091830:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:1.0:1787862673.092591:0:13067:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a650911df60 - data ffff9a653e9d1a20/ffff9a65346f8800 00000020:01000000:1.0:1787862673.092768:0:13067:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a6505128c60 - data ffff9a6539f8a1b0/ffff9a6537ff6000 00000100:00100000:2.0:1787862673.099569:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a42d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3281:x1874709526441344:12345-0@lo:103:ldlm_bl.0 Request processed in 16010us (16859us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787862673.099583:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787862673.104393:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787862673.113763:0:3282:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.160@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787862673.113770:0:3282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787862673.113797:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a65341483c0 x1874709526440960/t0(0) o400->MGC192.168.202.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787862684 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862673.113815:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a64019f2d00 x1874709526441344/t0(0) o103->MGC192.168.202.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787862689 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862673.113825:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a651fae8b40 x1874709526441472/t0(0) o103->MGC192.168.202.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787862689 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862673.113834:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a651fae9680 x1874709526441600/t0(0) o103->MGC192.168.202.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787862689 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787862673.113842:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787862673.113845:0:3282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787862673.113847:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787862673.115303:0:3283:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a651c1b4800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1787862673.115512:0:3281:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a651c1b4800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787862673.115536:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43a6d3ac-1408-47c4-9e06-195b8e037a27:3281:1874709526441344:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787862673.115844:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9a651c1b4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787862673.115851:0:3282:0:(import.c:510:import_select_connection()) MGC192.168.202.160@tcp: connect to NID 0@lo last attempt 126 00000100:00080000:0.0:1787862673.115860:0:3282:0:(import.c:624:import_select_connection()) MGC192.168.202.160@tcp: import ffff9a651c1b4800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787862673.115926:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651faeb840 x1874709526441728/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862673.115952:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43a6d3ac-1408-47c4-9e06-195b8e037a27:3282:1874709526441472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862673.116012:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:43a6d3ac-1408-47c4-9e06-195b8e037a27:3280:1874709526441728:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1787862673.116113:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874709526441728 offset 0 length 520: 4 00000100:00100000:2.0:1787862673.116477:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526440960:0@lo:400:kworker.0 00000100:00100000:2.0:1787862673.116496:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43a6d3ac-1408-47c4-9e06-195b8e037a27:3283:1874709526441600:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1787862673.124433:0:13067:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787862673.265260:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fac6 00000020:00000080:0.0:1787862673.265271:0:13067:0:(genops.c:885:class_export_put()) final put ffff9a64011ea000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787862673.265282:0:13067:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a653d6d2000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787862673.265286:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a653d6d2000 2 00000020:01000004:0.0:1787862673.265289:0:13067:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a653d6d2000 from lustre-OST0000 00000020:00000080:0.0:1787862673.265313:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862673.265324:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787862673.265327:0:13067:0:(genops.c:885:class_export_put()) final put ffff9a64011ea800/lustre-OST0000_UUID 00000020:00000080:0.0:1787862673.265330:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9a64011ea800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787862673.265336:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787862673.265427:0:13067:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787862673.265433:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787862673.265448:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787862673.265454:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787862673.265461:0:13067:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a6507b10000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787862673.265468:0:13067:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9a65401c8000) has exports, disconnecting them 00000020:00080000:0.0:1787862673.265474:0:13067:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a6507b10000), last request at 1787862419 00000020:00000080:0.0:1787862673.265478:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892faf0 00000020:00080000:0.0:1787862673.265487:0:13067:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6507b10000): rc 0 00000020:00000080:0.0:1787862673.265492:0:13067:0:(genops.c:885:class_export_put()) final put ffff9a6507b10000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787862673.266251:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a64011ea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787862673.266269:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6507b10000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787862673.279334:0:13067:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787862673.279343:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787862673.279358:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787862673.279365:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787862673.279549:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862673.279558:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787862673.279564:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a653d6d2000 1 00000020:00000080:3.0:1787862673.279583:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fa80 00000020:00000080:3.0:1787862673.279592:0:13067:0:(genops.c:885:class_export_put()) final put ffff9a6509831000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787862673.279598:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787862673.279602:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787862673.279606:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787862673.279609:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a653aa28000) has no exports 00000020:00000080:0.0:1787862673.279714:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c991800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787862673.279721:0:37:0:(genops.c:885:class_export_put()) final put ffff9a6507b12000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787862673.279724:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6507b12000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787862673.279729:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787862673.279786:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6509831000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787862673.294564:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787862673.294583:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787862673.294589:0:13067:0:(genops.c:885:class_export_put()) final put ffff9a653d6d5800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787862673.294594:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9a653d6d5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787862673.294608:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787862673.294751:0:13067:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a653d6d7000 00000020:02000400:0.0:1787862673.294811:0:13067:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787862673.553131:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862674.078397:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 43a6d3ac-1408-47c4-9e06-195b8e037a27->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787862674.078410:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 43a6d3ac-1408-47c4-9e06-195b8e037a27->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787862674.078413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787862674.078416:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787862674.078421:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862674.078429:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 394 00000100:00080000:1.0:1787862674.078435:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787862674.078441:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a651c994800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862674.078479:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401a41a40 x1874709526441856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862674.078610:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526441856:0@lo:38:kworker.0 00000400:00000100:0.0:1787862674.078680:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874709526441856 offset 0 length 520: 4 00010000:00010000:2.0:1787862674.589438:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862675.618985:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787862676.496511:0:13218:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787862676.526768:0:13218:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787862676.526851:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.526866:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.526874:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.526895:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.526928:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787862676.526934:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787862676.526959:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787862676.526971:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6401a41a40 x1874709526441856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787862694 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862676.526991:0:13218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787862676.526997:0:13218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787862676.527004:0:13218:0:(import.c:65:import_set_state_nolock()) ffff9a651c994800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787862676.527009:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787862676.527012:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6401a41a40 x1874709526441856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787862694 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862676.527020:0:13218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787862676.527023:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:1.0:1787862676.527149:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862676.527172:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862676.527180:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfda00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862676.527184:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862676.527198:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862676.527206:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862676.527213:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862676.527215:0:7622:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787862676.527217:0:7622:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787862676.527231:0:7622:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651c1b4800 00010000:00010000:1.0:1787862676.527235:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862676.527241:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfda00/0x9c5536ccf892fc9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fca2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862676.527251:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862676.527253:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862676.527255:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862676.527426:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526441856:0@lo:38:kworker.0 00010000:00010000:2.0:1787862676.538687:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538707:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538714:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538721:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538765:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862676.538773:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538779:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538784:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538791:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862676.538809:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787862676.538815:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787862676.538838:0:13218:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787862676.538843:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787862676.538848:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862676.538853:0:13218:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787862676.538857:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a6533ee8000) has no exports 00010000:00010000:3.0:1787862676.539224:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862676.539233:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539241:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc800 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862676.539246:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539253:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862676.539261:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862676.539266:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787862676.539269:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787862676.539271:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787862676.539285:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651c1b4800 00010000:00010000:3.0:1787862676.539289:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539296:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6509bfc800/0x9c5536ccf892fca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fcb0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539322:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862676.539326:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539331:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a654204e400 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862676.539334:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539341:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862676.539347:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862676.539352:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787862676.539354:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787862676.539356:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787862676.539361:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651c1b4800 00010000:00010000:3.0:1787862676.539364:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539370:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a654204e400/0x9c5536ccf892fee0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fee7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862676.539382:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862676.539384:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862676.539385:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787862676.539648:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a6533ee8000) has no exports 00010000:00010000:0.0:1787862676.541238:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787862676.545663:0:13218:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a650911d960 - data ffff9a653e9d1798/ffff9a65346f8000 00000020:01000000:1.0:1787862676.545820:0:13218:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9a650569bf60 - data ffff9a653e859000/ffff9a651fe91c00 00100000:10000000:1.0:1787862676.565964:0:13218:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:1.0:1787862676.650676:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787862676.697745:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fb91 00000020:00000080:1.0:1787862676.697755:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a651fef7000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787862676.697778:0:13218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a651c992800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787862676.697782:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a651c992800 2 00000020:01000004:1.0:1787862676.697785:0:13218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a651c992800 from lustre-OST0001 00000020:00000080:1.0:1787862676.697810:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787862676.697822:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787862676.697825:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a651c226800/lustre-OST0001_UUID 00000020:00000080:1.0:1787862676.697828:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c226800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787862676.697835:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787862676.697953:0:13218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 43a6d3ac-1408-47c4-9e06-195b8e037a27->MGS 00010000:00010000:1.0:1787862676.697970:0:13218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862676.697982:0:13218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862676.697988:0:13218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787862676.697991:0:13218:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787862676.697995:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787862676.698009:0:13218:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651c1b4800 00010000:00010000:1.0:1787862676.698013:0:13218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af44200/0x9c5536ccf892faa3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892faaa expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862676.698026:0:13218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862676.698032:0:13218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862676.698037:0:13218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787862676.698098:0:13218:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787862676.698112:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787862676.698126:0:13218:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a651c1b4800 00010000:00010000:1.0:1787862676.698129:0:13218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a650af44400/0x9c5536ccf892fcef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c5536ccf892fcf6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787862676.698148:0:13218:0:(import.c:65:import_set_state_nolock()) ffff9a651c1b4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787862676.698153:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787862676.698156:0:13218:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787862676.698157:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787862676.698163:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787862676.698175:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a651faeb840 x1874709526441728/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787862683 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787862676.698450:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787862676.698455:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1787862676.698498:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:43a6d3ac-1408-47c4-9e06-195b8e037a27:3280:1874709526441728:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1787862676.698651:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787862676.698660:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892f984 00000020:00000080:2.0:1787862676.698665:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a651c995000/43a6d3ac-1408-47c4-9e06-195b8e037a27 00000020:01000000:2.0:1787862676.698672:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.160@tcp (flags='') 00000020:00000080:2.0:1787862676.698679:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862676.698684:0:13218:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787862676.698688:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a653aa2b490) has no exports 00000020:00000080:3.0:1787862676.699105:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651fef7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787862676.699131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c995000/43a6d3ac-1408-47c4-9e06-195b8e037a27 for MGC192.168.202.160@tcp 10000000:01000000:1.0:1787862676.699541:0:5813:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787862676.699647:0:13218:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.160@tcp: client import never connected 00000100:00080000:2.0:1787862676.699651:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787862676.699662:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787862676.699665:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787862676.699667:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787862676.699720:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787862676.699728:0:13218:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.160@tcp (uuid 43a6d3ac-1408-47c4-9e06-195b8e037a27) 00000020:01000000:2.0:1787862676.699735:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787862676.699739:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862676.699743:0:13218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787862676.699750:0:13218:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a6504d5e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787862676.699756:0:13218:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9a651c9d4ed8) has exports, disconnecting them 00000020:00080000:2.0:1787862676.699760:0:13218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a6504d5e800), last request at 1787862440 00000020:00000080:2.0:1787862676.699765:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fbbb 00000020:00080000:2.0:1787862676.699777:0:13218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6504d5e800): rc 0 00000020:00000080:2.0:1787862676.699781:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a6504d5e800/lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787862676.700774:0:13218:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787862676.700782:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787862676.700786:0:13218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787862676.700793:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787862676.700965:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787862676.701825:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c1b4800 for MGC192.168.202.160@tcp 00000020:00000080:3.0:1787862676.701839:0:36:0:(genops.c:885:class_export_put()) final put ffff9a651c1b7800/43a6d3ac-1408-47c4-9e06-195b8e037a27 00000020:00000080:3.0:1787862676.701843:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651c1b7800/43a6d3ac-1408-47c4-9e06-195b8e037a27 for MGC192.168.202.160@tcp 00000020:01000000:3.0:1787862676.701850:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.160@tcp (43a6d3ac-1408-47c4-9e06-195b8e037a27) 00000020:00000080:2.0:1787862676.702696:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787862676.702707:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a651c992800 1 00000020:00000080:2.0:1787862676.702715:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf892fb60 00000020:00000080:2.0:1787862676.702722:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a651f8d3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787862676.702749:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787862676.702756:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787862676.702760:0:13218:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787862676.702764:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a6533ee9a48) has no exports 00010000:00010000:1.0:1787862676.702879:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787862676.702991:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787862676.703065:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787862676.703130:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787862676.703229:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a6509e24800:5798] 0 exiting: rc = 1 00000100:00100000:1.0:1787862676.703275:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a651154f400:5799] 1 exiting: rc = 0 00000100:00100000:1.0:1787862676.703507:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.703760:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a6502e9e800:5801] 1 exiting: rc = 0 00000100:00100000:1.0:1787862676.703825:0:8440:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a651ca8ee00:8440] 3 exiting: rc = 0 00000100:00100000:1.0:1787862676.703888:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a651154e600:5800] 0 exiting: rc = 1 00000100:00100000:1.0:1787862676.703938:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a6509c29800:5802] 2 exiting: rc = 0 00000100:00100000:1.0:1787862676.703982:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.703990:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.703997:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704002:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704024:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704031:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704037:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704081:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704088:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704094:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704100:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704106:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704113:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704119:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704125:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704131:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704137:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704142:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704146:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704152:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704157:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704162:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704167:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704172:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704178:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704183:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704707:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704720:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704726:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704731:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704736:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704742:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704747:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704752:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704758:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704763:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704769:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704774:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704779:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704795:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704800:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704804:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704810:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704816:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704822:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704827:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704832:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704837:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704842:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704848:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704853:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704858:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704863:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704867:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704872:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704877:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704883:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704888:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704893:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704898:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704904:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704910:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704916:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.704921:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787862676.720873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6504d5e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787862676.720886:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a651c994800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787862676.720893:0:36:0:(genops.c:885:class_export_put()) final put ffff9a65403a8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787862676.720896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65403a8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787862676.720903:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787862676.720943:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a651f8d3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787862676.751811:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787862676.751829:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787862676.751865:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a65401d2000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787862676.751870:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff9a65401d2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787862676.751878:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787862676.752154:0:13218:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a65401d5800 00000020:01000000:1.0:1787862676.752177:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787862676.752181:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787862676.752187:0:13218:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787862676.752191:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a6526ce1a48) has no exports 00000020:00000080:1.0:1787862676.752215:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787862676.752221:0:13218:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787862676.752224:0:13218:0:(genops.c:885:class_export_put()) final put ffff9a6509834800/OSS_uuid 00000020:00000080:1.0:1787862676.752226:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6509834800/OSS_uuid for OSS 00000020:01000000:1.0:1787862676.752231:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787862676.752260:0:5811:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787862676.752425:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a6533e3a600:6670] 0 exiting: rc = 1 00000100:00100000:1.0:1787862676.753163:0:11687:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a650ad69000:11687] 3 exiting: rc = 0 00000100:00100000:2.0:1787862676.753921:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a653d5df600:6672] 2 exiting: rc = 0 00000100:00100000:2.0:1787862676.754009:0:12006:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9a6517b73000:12006] 4 exiting: rc = 0 00000100:00100000:2.0:1787862676.754394:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a6533e3ba00:6671] 1 exiting: rc = 0 00000100:00100000:1.0:1787862676.754661:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754670:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754677:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754682:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754688:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754693:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754697:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754702:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754707:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754711:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754716:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754720:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754725:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754731:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754736:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754740:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754745:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754750:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754768:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754772:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754777:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754783:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754788:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754793:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754798:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754803:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754809:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754815:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754819:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754825:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754830:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754835:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754840:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754845:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754862:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754869:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754875:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754880:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754887:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754896:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754902:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754907:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754911:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754916:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754920:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754925:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754930:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754938:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754945:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754964:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754970:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754977:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754983:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.754998:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755004:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755011:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755018:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755023:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755028:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755033:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755038:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755062:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755229:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.755234:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862676.759276:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a653d5df800:6673] 0 exiting: rc = 1 00000100:00100000:1.0:1787862676.761393:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a65402e6e00:6674] 1 exiting: rc = 0 00000100:00100000:1.0:1787862676.762062:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762138:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762143:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762148:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762152:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762156:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762161:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762166:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762171:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762176:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762180:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762186:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762191:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762196:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762200:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762205:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762209:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762213:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762217:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762222:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762227:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762232:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762236:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762257:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762262:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762267:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762271:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762276:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762286:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762291:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762297:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762302:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762306:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762312:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762318:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762322:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762327:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762331:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762335:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762339:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762343:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762349:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762354:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762359:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762363:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762367:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762372:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762378:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762383:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762389:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762394:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762400:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762405:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762411:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762416:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762420:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762426:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762430:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762442:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762447:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762451:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.762457:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.763039:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.763247:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.766543:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a6511664e00:6677] 2 exiting: rc = 0 00000100:00100000:3.0:1787862676.769031:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a6511665000:6675] 0 exiting: rc = 1 00000100:00100000:0.0:1787862676.770584:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a6511665a00:6676] 1 exiting: rc = 0 00000100:00100000:1.0:1787862676.770858:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770877:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770886:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770894:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770917:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770926:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770935:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770942:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770962:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770971:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770978:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770985:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.770994:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771001:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771008:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771016:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771024:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771031:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771060:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771070:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771075:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771082:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771089:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771094:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771099:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771106:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771112:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771117:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771153:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771162:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771169:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771176:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771182:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771189:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771195:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771200:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771206:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771213:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771218:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771224:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771229:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771235:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771241:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771249:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771255:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771262:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771270:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771277:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771283:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771289:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771294:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771300:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771323:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771330:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771336:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771343:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771349:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771355:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771360:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771365:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771371:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771376:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771383:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.771396:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.793360:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a6511665600:6679] 1 exiting: rc = 0 00000100:00100000:3.0:1787862676.794480:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a6511665400:6678] 0 exiting: rc = 1 00000100:00100000:1.0:1787862676.795985:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.795996:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796002:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796007:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796012:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796019:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796025:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796091:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796098:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796104:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796109:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796114:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796119:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796125:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796130:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796136:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796141:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796147:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796153:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796157:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796162:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796168:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796172:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796178:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796183:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796187:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796192:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796197:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796203:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796208:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796214:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796219:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796224:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796244:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796250:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796254:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796259:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796264:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796269:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796274:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796280:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796288:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796294:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796300:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796304:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796704:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796710:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796714:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796719:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796724:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796729:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796734:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796739:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796743:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796749:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796756:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796761:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796766:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796771:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796776:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796782:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796789:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796794:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.796798:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787862676.801710:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a65092eda00:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1787862676.805427:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a653d699e00:6681] 1 exiting: rc = 0 00000100:00100000:1.0:1787862676.805756:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805764:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805771:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805796:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805802:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805808:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805814:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805819:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805825:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805847:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805854:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805860:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805866:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805872:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805878:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805884:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805890:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805897:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805903:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805909:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805914:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805933:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805941:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.805947:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806022:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806029:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806036:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806407:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806416:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806422:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806428:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806433:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806441:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806592:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806600:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806610:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806625:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806633:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806648:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806654:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806660:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806666:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806674:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806681:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806687:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806707:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806713:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806720:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806727:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806732:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806738:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806744:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806750:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806763:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806770:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806775:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806781:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806802:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806810:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806816:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806822:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806836:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806854:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787862676.806869:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787862676.818126:0:13218:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787862699.133299:0:13835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787862711.468331:0:14296:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787862711.468350:0:14296:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787862711.468485:0:14296:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a650ac37800 00000020:01000004:2.0:1787862711.468507:0:14296:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787862711.468516:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787862711.468533:0:14296:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a6533eeced8) 00000020:00000080:2.0:1787862711.468551:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787862711.483473:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787862711.496848:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787862711.502731:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787862711.502962:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787862711.504334:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787862711.504477:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787862711.504573:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787862711.504671:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787862711.504765:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787862711.509609:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1787862711.518769:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 274: rc = 0 00100000:10000000:3.0:1787862711.518878:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 274: rc = 0 00100000:10000000:3.0:1787862711.519375:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 642: rc = 0 00100000:10000000:3.0:1787862711.519722:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787862711.519972:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787862711.520247:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 642: rc = 0 00100000:10000000:3.0:1787862711.520518:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787862711.520769:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 642: rc = 0 00100000:10000000:3.0:1787862711.521069:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787862711.533277:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1787862711.533653:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1787862711.533947:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787862711.534232:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 642: rc = 0 00100000:10000000:3.0:1787862711.534523:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1787862711.534997:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:3.0:1787862711.535310:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:3.0:1787862711.535551:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:3.0:1787862711.535804:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:2.0:1787862711.553914:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:2.0:1787862711.554625:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:2.0:1787862711.554889:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:2.0:1787862711.556692:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:2.0:1787862711.557308:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:2.0:1787862711.557591:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:2.0:1787862711.557866:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:2.0:1787862711.560830:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:2.0:1787862711.561903:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:2.0:1787862711.562515:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:2.0:1787862711.563221:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:2.0:1787862711.563500:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:2.0:1787862711.566637:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:2.0:1787862711.567507:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:2.0:1787862711.568363:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:2.0:1787862711.568610:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:2.0:1787862711.576441:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:2.0:1787862711.576825:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:2.0:1787862711.580326:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:2.0:1787862711.580698:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:0.0:1787862711.587384:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:0.0:1787862711.587667:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:0.0:1787862711.587931:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:0.0:1787862711.588208:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:0.0:1787862711.588471:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:0.0:1787862711.588719:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:0.0:1787862711.588968:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:0.0:1787862711.589250:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:0.0:1787862711.589644:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 596: rc = 0 00100000:10000000:0.0:1787862711.590227:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787862711.598445:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 275: rc = 0 00100000:10000000:0.0:1787862711.599012:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787862711.599191:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 275: rc = 0 00100000:10000000:0.0:1787862711.599426:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787862711.599494:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 275: rc = 0 00100000:10000000:0.0:1787862711.600546:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787862711.600621:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:0.0:1787862711.604693:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787862711.604797:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:0.0:1787862711.606767:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787862711.606921:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00000020:00000080:0.0:1787862711.608488:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787862711.608498:0:14296:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787862711.608512:0:14296:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930c85 00000020:01000004:0.0:1787862711.608520:0:14296:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787862711.608526:0:14296:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787862711.608531:0:14296:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a650ac37800 from MGS 00000020:01000004:0.0:1787862711.608536:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787862711.608549:0:14296:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a651c9d0000) 00000020:00000080:0.0:1787862711.608559:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787862711.608634:0:14296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650ac37800 from MGS, refs=2 00080000:01000000:0.0:1787862711.608640:0:14296:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787862711.608646:0:14296:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930c93 00000100:00100000:0.0:1787862711.608956:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787862711.609330:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787862711.609338:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787862711.610469:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787862711.610481:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787862711.611336:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862711.611522:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787862711.611529:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787862711.614981:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787862711.615006:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787862711.615571:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787862711.615579:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787862711.616428:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862711.616432:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862711.616434:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862711.616664:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862711.616666:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862711.616668:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862711.622577:0:14296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787862711.637152:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787862711.669077:0:14296:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787862711.671233:0:14296:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787862711.671240:0:14296:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787862711.681301:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787862711.681537:0:14296:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787862711.681659:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787862711.682289:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787862711.682607:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862711.682808:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787862711.682814:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787862711.689226:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787862711.689239:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787862711.690514:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787862711.690524:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787862711.696401:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787862711.696434:0:14296:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.160@tcp' 00000020:01000004:2.0:1787862711.696436:0:14296:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787862711.696473:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.160@tcp (typ=mgc) 00000020:00000080:2.0:1787862711.696489:0:14296:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.160@tcp (ffff9a6533eeb490) 00000020:00000080:2.0:1787862711.696507:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787862711.696850:0:14296:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a651fe84000@MGC192.168.202.160@tcp: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1787862711.697739:0:14296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.160@tcp-0 is initialized 00000040:01000000:2.0:1787862711.697835:0:14296:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787862711.698127:0:14310:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787862711.708708:0:14311:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787862711.709239:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.160@tcp (uuid 5934abbb-415c-4dd1-a04f-dfe9aec97c5f) 00000020:00000080:3.0:1787862711.709265:0:14296:0:(genops.c:1385:class_connect()) connect: client 5934abbb-415c-4dd1-a04f-dfe9aec97c5f, cookie 0x9c5536ccf8930ca1 00000100:00080000:3.0:1787862711.709277:0:14296:0:(import.c:510:import_select_connection()) MGC192.168.202.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787862711.709284:0:14296:0:(import.c:624:import_select_connection()) MGC192.168.202.160@tcp: import ffff9a651fe84000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787862711.709335:0:14296:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64031dc000 x1874709526441984/t0(0) o250->MGC192.168.202.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787862711.709364:0:14296:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5934abbb-415c-4dd1-a04f-dfe9aec97c5f->MGS 00000020:01000004:3.0:1787862711.709390:0:14296:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787862711.709395:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787862711.709407:0:14296:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a640328b490) 00000020:00000080:3.0:1787862711.709418:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787862711.709727:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3280:1874709526441984:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787862711.709817:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862711.709926:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526441984 00000100:00100000:2.0:1787862711.709934:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526441984 00000100:00100000:2.0:1787862711.709967:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862711.709976:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3280:x1874709526441984:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787862711.710012:0:14307:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 5934abbb-415c-4dd1-a04f-dfe9aec97c5f@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787862711.710036:0:14307:0:(genops.c:1385:class_connect()) connect: client 5934abbb-415c-4dd1-a04f-dfe9aec97c5f, cookie 0x9c5536ccf8930caf 00000100:00080000:2.0:1787862711.710197:0:14307:0:(import.c:65:import_set_state_nolock()) ffff9a651fe80000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862711.710251:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+5:3280:x1874709526441984:12345-0@lo:250:mount.lustre.0 Request processed in 276us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862711.710270:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862711.710689:0:3280:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787862711.710698:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.160@tcp: connect to target with instance 0 00000100:00080000:1.0:1787862711.710706:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787862711.710710:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787862711.710719:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651fe84000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787862711.710722:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787862711.710739:0:3280:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787862711.710755:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3280:1874709526441984:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787862711.732368:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862711.732561:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787862711.732567:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787862711.735530:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862711.735545:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787862711.736652:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787862711.736664:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787862711.742869:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862711.743089:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787862711.743095:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787862711.748827:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787862711.748849:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787862711.817903:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862711.818164:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787862711.818171:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787862711.820646:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787862711.820662:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787862711.823305:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787862711.823532:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787862711.823538:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787862711.824445:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787862711.824455:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787862711.825280:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787862711.825499:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787862711.825505:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787862711.828500:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787862711.828519:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787862711.832594:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862711.832962:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787862711.832970:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787862711.834023:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787862711.834033:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787862711.850972:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862711.851399:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787862711.851406:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787862711.853232:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862711.853249:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787862711.854486:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862711.854504:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787862711.855934:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787862711.855957:0:14296:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787862711.855964:0:14296:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787862711.856395:0:14296:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787862711.856430:0:14296:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787862711.856436:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787862711.856437:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787862711.856439:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862711.856441:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862711.856442:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862711.856444:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862711.856445:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787862711.856446:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787862711.856449:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862711.856450:0:14296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787862711.856453:0:14296:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787862711.856456:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787862711.856457:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787862711.856458:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862711.856459:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862711.856460:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862711.856461:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862711.856462:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787862711.856463:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787862711.856464:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862711.856465:0:14296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787862711.856499:0:14296:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787862711.856522:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787862711.856622:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.856680:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1787862711.856748:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442112 00000100:00100000:2.0:1787862711.856756:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442112 00000100:00100000:2.0:1787862711.856803:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862711.856814:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+5:14296:x1874709526442112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787862711.856860:0:14309:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787862711.856863:0:14309:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787862711.856866:0:14309:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787862711.857401:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787862711.857773:0:14309:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787862711.858875:0:14331:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787862711.858882:0:14331:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787862711.858884:0:14331:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787862711.858914:0:14331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787862711.859356:0:14309:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787862711.859370:0:14309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787862711.865400:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+5:14296:x1874709526442112:12345-0@lo:253:mount.lustre.0 Request processed in 8576us (8765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862711.865435:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862711.865536:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442112:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787862711.865555:0:14296:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787862711.865558:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862711.865560:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787862711.865562:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862711.865563:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862711.865565:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862711.865566:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862711.865567:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787862711.865575:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787862711.865577:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862711.865578:0:14296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787862711.865602:0:14296:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a650ac37800 from lustre-MDT0000 10000000:01000000:0.0:1787862711.865632:0:14296:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787862711.865635:0:14296:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787862711.865642:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a6533eeb490 10000000:01000000:0.0:1787862711.865647:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862711.865657:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6533eeb490 from 1 10000000:01000000:0.0:1787862711.865661:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787862711.865706:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.865718:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.865729:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862711.865751:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787862711.865789:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.865867:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862711.865920:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442240 00000100:00100000:2.0:1787862711.865927:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442240 00000100:00100000:2.0:1787862711.866008:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862711.866018:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+5:14296:x1874709526442240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862711.866032:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862711.866077:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919e00/0x9c5536ccf8930cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930cb6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862711.866244:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919e00/0x9c5536ccf8930cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930cb6 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862711.866257:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919e00/0x9c5536ccf8930cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930cb6 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862711.866269:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919e00, rc 0) 00000100:00100000:2.0:1787862711.866319:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+6:14296:x1874709526442240:12345-0@lo:101:mount.lustre.0 Request processed in 302us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862711.866325:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862711.866405:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862711.866419:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.866429:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862711.866491:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862711.866533:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.867367:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862711.872162:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442368 00000100:00100000:3.0:1787862711.872178:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442368 00000100:00100000:3.0:1787862711.872258:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862711.872530:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+6:14296:x1874709526442368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862711.872923:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+6:14296:x1874709526442368:12345-0@lo:501:mount.lustre.0 Request processed in 654us (6388us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787862711.872931:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862711.873567:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442368:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787862711.873616:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787862711.873641:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.873652:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862711.873663:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a650ac37800 10000000:01000000:0.0:1787862711.873669:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787862711.873674:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a650ac37800 10000000:01000000:0.0:1787862711.873679:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787862711.873682:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a650ac37800 from 1 10000000:01000000:0.0:1787862711.873685:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787862711.873717:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.873725:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.873735:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862711.873756:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787862711.873801:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.873841:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862711.873904:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442496 00000100:00100000:3.0:1787862711.873909:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442496 00000100:00100000:3.0:1787862711.873955:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862711.873963:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+6:14296:x1874709526442496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862711.873976:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862711.874003:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422d800/0x9c5536ccf8930ccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930cc4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862711.874028:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422d800/0x9c5536ccf8930ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930cc4 expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862711.874074:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422d800/0x9c5536ccf8930ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930cc4 expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862711.874095:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d800, rc 0) 00000100:00100000:3.0:1787862711.874128:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+7:14296:x1874709526442496:12345-0@lo:101:mount.lustre.0 Request processed in 166us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862711.874134:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787862711.875425:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862711.875467:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.875478:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862711.875496:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787862711.875501:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.875508:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534637a00/0x9c5536ccf8930cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930ccb expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862711.875516:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787862711.875520:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787862711.875527:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a650ac37800 10000000:01000000:0.0:1787862711.875529:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787862711.875533:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787862711.875536:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787862711.875557:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.875564:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.875571:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862711.875588:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787862711.875642:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.875687:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862711.876730:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442624 00000100:00100000:3.0:1787862711.876745:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442624 00000100:00100000:3.0:1787862711.876817:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862711.876830:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+7:14296:x1874709526442624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862711.876848:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862711.876868:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422d400/0x9c5536ccf8930cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930cd2 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862711.876892:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422d400/0x9c5536ccf8930cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930cd2 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862711.876902:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422d400/0x9c5536ccf8930cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930cd2 expref: 8 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862711.876911:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d400, rc 0) 00000100:00100000:3.0:1787862711.876971:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+8:14296:x1874709526442624:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862711.876978:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862711.877568:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862711.877585:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862711.877593:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862711.877665:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862711.877705:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.877733:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862711.877778:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442752 00000100:00100000:3.0:1787862711.877783:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442752 00000100:00100000:3.0:1787862711.877819:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862711.877827:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+8:14296:x1874709526442752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862711.878660:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14296:x1874709526442752:12345-0@lo:501:mount.lustre.0 Request processed in 833us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862711.878670:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862711.879564:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862711.879630:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862711.879688:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862711.879723:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862711.879789:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526442880 00000100:00100000:3.0:1787862711.879797:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526442880 00000100:00100000:3.0:1787862711.879950:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862711.879961:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14296:x1874709526442880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862711.880392:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14296:x1874709526442880:12345-0@lo:503:mount.lustre.0 Request processed in 433us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862711.880399:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787862711.880542:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526442880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862711.881514:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14332:1874709526443008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862711.881577:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862711.881899:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149540 going to sleep for 11 seconds 00000100:00100000:0.0:1787862711.881939:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526443008 00000100:00100000:0.0:1787862711.881946:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526443008 00000100:00100000:0.0:1787862711.881982:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862711.881991:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14332:x1874709526443008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862711.882695:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14332:x1874709526443008:12345-0@lo:502:llog_process_th.0 Request processed in 701us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862711.882703:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787862711.882942:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14332:1874709526443008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862711.882972:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862711.882998:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862711.883007:0:14332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787862711.883014:0:14332:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787862711.883017:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862711.883035:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a6533ee9a48) 00000020:00000080:2.0:1787862711.883086:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787862711.883108:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787862711.883183:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787862711.883190:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930ce7 00000020:00000080:2.0:1787862711.883587:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787862711.883593:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862711.883598:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862711.883599:0:14332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787862711.883603:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862711.883607:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862711.883608:0:14332:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787862711.883612:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862711.883620:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a6533ee8000) 00000020:00000080:2.0:1787862711.883631:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787862711.883636:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787862711.883638:0:14332:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787862711.883641:0:14332:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787862711.883646:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787862711.883706:0:14332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650ac37800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787862711.883720:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a65401c8000) 00000020:00000080:2.0:1787862711.883729:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787862711.883918:0:14332:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787862711.883925:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf8930cfc 00000020:00000080:2.0:1787862711.884123:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787862711.884130:0:14332:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787862711.884136:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c5536ccf8930d03 00080000:01000000:2.0:1787862711.884141:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787862711.884144:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930d0a 00010000:00010000:1.0:1787862711.972840:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787862711.973696:0:14332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787862711.973908:0:14332:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787862711.974468:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a6526ce1a48) 00000020:00000080:1.0:1787862711.974487:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787862711.974563:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787862711.974570:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930d18 00000020:00000080:1.0:1787862711.978823:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787862711.990246:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c5536ccf8930d1f 00000020:00000080:0.0:1787862711.990707:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787862711.990721:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862711.990729:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862711.990736:0:14332:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787862711.990742:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787862711.990745:0:14332:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787862711.990747:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787862711.990748:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787862711.990749:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787862711.990752:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862711.990753:0:14332:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787862711.990756:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862711.990760:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862711.990761:0:14332:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787862711.990766:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787862711.990804:0:14332:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787862711.990821:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862711.990824:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862711.990825:0:14332:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787862711.990827:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787862711.990830:0:14332:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787862711.990833:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862711.990834:0:14332:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787862711.990837:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787862711.990841:0:14332:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:0.0:1787862711.990872:0:14332:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787862711.990875:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787862711.990891:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a651c9d4ed8) 00000020:00000080:0.0:1787862711.990909:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787862711.990914:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787862711.990977:0:14332:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787862711.990983:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787862711.991233:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930d2d 00010000:00080000:0.0:1787862711.991272:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a651c1f5800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:0.0:1787862711.991523:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787862711.991927:0:14332:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787862711.992650:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787862711.996227:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862711.996310:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787862711.996394:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787862711.997339:0:14337:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862711.997344:0:14337:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787862711.998119:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862711.998247:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787862711.998296:0:14332:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787862711.998319:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf8930d34 00000100:00080000:2.0:1787862711.998329:0:14332:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862711.998335:0:14332:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a651c1f5800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862711.998374:0:14332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64019f3c00 x1874709526443136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787862711.998398:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787862711.998499:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862711.998502:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862711.998504:0:14332:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787862711.998515:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787862711.998518:0:14332:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787862711.998519:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787862711.998521:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787862711.998522:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787862711.998525:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862711.998527:0:14332:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787862711.998529:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787862711.998534:0:14332:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787862711.998536:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862711.998537:0:14332:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787862711.998540:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787862711.998543:0:14332:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.160@tcp to nid 0x20000c0a8caa0 (192.168.202.160@tcp) 00000020:01000000:2.0:1787862711.998565:0:14332:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787862711.998567:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787862711.998580:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a65401cb490) 00000020:00000080:2.0:1787862711.998590:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787862711.998594:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787862711.998650:0:14332:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787862711.998655:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787862711.998660:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c5536ccf8930d42 00010000:00080000:2.0:1787862711.998701:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a653daec000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1787862711.998889:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787862711.999103:0:14332:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787862711.999135:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787862711.999629:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862711.999683:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787862711.999754:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1787862712.000021:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526443136:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787862712.000129:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526443136 offset 0 length 520: 4 00000040:00080000:3.0:1787862712.001309:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862712.001316:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787862712.002273:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787862712.002295:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787862712.002330:0:14332:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787862712.002361:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf8930d49 00000100:00080000:2.0:1787862712.002372:0:14332:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862712.002380:0:14332:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862712.002422:0:14332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64019f12c0 x1874709526443264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862712.002483:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526443264:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787862712.002607:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526443264 offset 0 length 520: 4 00000100:00080000:2.0:1787862712.002668:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787862712.002734:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862712.002738:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862712.002740:0:14332:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787862712.002743:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862712.002747:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862712.002749:0:14332:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787862712.002752:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787862712.002754:0:14332:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787862712.002757:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862712.002759:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862712.002760:0:14332:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787862712.002762:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787862712.002765:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862712.002766:0:14332:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787862712.002770:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787862712.002802:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14332:1874709526443392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862712.002869:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.002885:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.003219:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526443392 00000100:00100000:0.0:1787862712.003227:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526443392 00000100:00100000:0.0:1787862712.003328:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862712.003338:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14332:x1874709526443392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.003604:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14332:x1874709526443392:12345-0@lo:502:llog_process_th.0 Request processed in 267us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.003612:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787862712.003697:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14332:1874709526443392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787862712.003726:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787862712.003730:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787862712.003732:0:14332:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787862712.003736:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787862712.003788:0:14296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787862712.003806:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787862712.003822:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.003834:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534637e00/0x9c5536ccf8930cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cd9 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862712.003842:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a650ac37800 from 1 10000000:01000000:2.0:1787862712.003846:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787862712.003876:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.003888:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.003897:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.003912:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862712.003958:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.005443:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149180 going to sleep for 11 seconds 00000100:00100000:3.0:1787862712.005621:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526443520 00000100:00100000:3.0:1787862712.005631:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526443520 00000100:00100000:3.0:1787862712.005670:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787862712.005678:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+9:14296:x1874709526443520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862712.005693:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862712.005712:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930d50 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862712.005738:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 10 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862712.005749:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 10 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862712.005758:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:3.0:1787862712.005813:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+10:14296:x1874709526443520:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862712.005820:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787862712.005927:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862712.005953:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.005963:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.007210:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443648:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787862712.007274:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.007314:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149180 going to sleep for 11 seconds 00000100:00100000:3.0:1787862712.007468:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526443648 00000100:00100000:3.0:1787862712.007475:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526443648 00000100:00100000:3.0:1787862712.007512:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787862712.007521:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+10:14296:x1874709526443648:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787862712.007561:0:14307:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787862712.007574:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787862712.007659:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+10:14296:x1874709526443648:12345-0@lo:256:mount.lustre.0 Request processed in 139us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862712.007666:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862712.007805:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443648:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787862712.008605:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862712.008680:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.008691:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862712.008700:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650ac37800 from 1 10000000:01000000:2.0:1787862712.008702:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862712.008736:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.008742:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.008752:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.008805:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862712.008846:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.008885:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.008983:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526443776 00000100:00100000:0.0:1787862712.008995:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526443776 00000100:00100000:0.0:1787862712.009036:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862712.009065:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+10:14296:x1874709526443776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862712.009076:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862712.009091:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930d5e expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.009112:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.009122:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.009140:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637400, rc 0) 00000100:00100000:0.0:1787862712.009178:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526443776:12345-0@lo:101:mount.lustre.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.009184:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787862712.009506:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862712.009520:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.009529:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.009580:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862712.009607:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.009629:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149180 going to sleep for 11 seconds 00000100:00100000:1.0:1787862712.009696:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526443904 00000100:00100000:1.0:1787862712.009701:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526443904 00000100:00100000:1.0:1787862712.009723:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787862712.009730:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526443904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862712.010397:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526443904:12345-0@lo:501:mount.lustre.0 Request processed in 665us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862712.010404:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862712.010476:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526443904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862712.010508:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862712.010546:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.010572:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509149180 going to sleep for 11 seconds 00000100:00100000:2.0:1787862712.010588:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444032 00000100:00100000:2.0:1787862712.010591:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444032 00000100:00100000:2.0:1787862712.010627:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862712.010634:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526444032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862712.010773:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526444032:12345-0@lo:503:mount.lustre.0 Request processed in 139us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862712.010780:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787862712.010823:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862712.011500:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14341:1874709526444160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.011543:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862712.011582:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862712.011631:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444160 00000100:00100000:2.0:1787862712.011635:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444160 00000100:00100000:2.0:1787862712.011671:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862712.011678:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14341:x1874709526444160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862712.011881:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14341:x1874709526444160:12345-0@lo:502:llog_process_th.0 Request processed in 202us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862712.011889:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862712.012303:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14341:1874709526444160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787862712.012335:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862712.012346:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862712.012348:0:14341:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787862712.012357:0:14341:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a650ac37800 00000020:00000080:0.0:1787862712.012360:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787862712.012368:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862712.012372:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862712.012373:0:14341:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787862712.012376:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862712.012378:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862712.012379:0:14341:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787862712.012383:0:14341:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a650ac37800 00000020:00000080:0.0:1787862712.012385:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787862712.012445:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862712.012449:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862712.012451:0:14341:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787862712.012454:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862712.012456:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862712.012457:0:14341:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787862712.012461:0:14341:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a650ac37800 00000020:00000080:0.0:1787862712.012463:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787862712.012500:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14341:1874709526444288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.012541:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862712.012563:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.014255:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444288 00000100:00100000:0.0:1787862712.014268:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444288 00000100:00100000:0.0:1787862712.015109:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787862712.015135:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14341:x1874709526444288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.015426:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14341:x1874709526444288:12345-0@lo:502:llog_process_th.0 Request processed in 306us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.015440:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862712.021442:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14341:1874709526444288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787862712.021501:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862712.021510:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862712.021512:0:14341:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787862712.021517:0:14341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787862712.026666:0:14296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787862712.026703:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862712.026731:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.026745:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862712.026808:0:14296:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787862712.026812:0:14296:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a650ac37800 10000000:01000000:2.0:1787862712.026815:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a650ac37800 10000000:01000000:2.0:1787862712.026819:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862712.026826:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a650ac37800 from 1 10000000:01000000:2.0:1787862712.026830:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862712.026881:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.026890:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.026904:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.026954:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862712.027192:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.027234:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.032155:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444416 00000100:00100000:0.0:1787862712.032173:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444416 00000100:00100000:0.0:1787862712.032240:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862712.032252:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526444416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862712.032273:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862712.032301:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534637200/0x9c5536ccf8930d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930d6c expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.032332:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534637200/0x9c5536ccf8930d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930d6c expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.032344:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534637200/0x9c5536ccf8930d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d6c expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.032353:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637200, rc 0) 00000100:00100000:0.0:1787862712.032436:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14296:x1874709526444416:12345-0@lo:101:mount.lustre.0 Request processed in 187us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.032443:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862712.035513:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862712.035546:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.035559:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.035644:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862712.035710:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.036818:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.042225:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444544 00000100:00100000:0.0:1787862712.042244:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444544 00000100:00100000:0.0:1787862712.042351:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862712.042362:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14296:x1874709526444544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862712.042718:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14296:x1874709526444544:12345-0@lo:501:mount.lustre.0 Request processed in 357us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.042726:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787862712.044366:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862712.044437:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862712.044501:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.044536:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.045302:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444672 00000100:00100000:0.0:1787862712.045320:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444672 00000100:00100000:0.0:1787862712.045376:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787862712.045386:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14296:x1874709526444672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862712.045587:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14296:x1874709526444672:12345-0@lo:503:mount.lustre.0 Request processed in 202us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.045595:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862712.045721:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526444672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862712.050036:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14346:1874709526444800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.050269:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862712.050317:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a49900 going to sleep for 11 seconds 00000100:00100000:2.0:1787862712.050378:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444800 00000100:00100000:2.0:1787862712.050386:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444800 00000100:00100000:2.0:1787862712.050437:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862712.050447:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14346:x1874709526444800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787862712.050718:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14346:x1874709526444800:12345-0@lo:502:llog_process_th.0 Request processed in 272us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862712.050735:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787862712.050791:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14346:1874709526444800:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787862712.050861:0:14346:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787862712.050876:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a65401cced8) 00000020:00000080:2.0:1787862712.050896:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787862712.050977:0:14346:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650ac37800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787862712.050981:0:14346:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650ac37800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787862712.051091:0:14346:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650ac37800 4 00010000:00080000:2.0:1787862712.051202:0:14346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a65081c4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1787862712.053573:0:14346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787862712.057389:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787862712.057437:0:14346:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787862712.057451:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c5536ccf8930d81 00000100:00080000:0.0:1787862712.057462:0:14346:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787862712.057469:0:14346:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a65081c4800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:0.0:1787862712.057532:0:14346:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a651faea580 x1874709526444928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787862712.057560:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787862712.057838:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526444928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787862712.057922:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862712.058253:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526444928 00000100:00100000:0.0:1787862712.058261:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526444928 00000100:00100000:0.0:1787862712.058301:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862712.058309:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526444928:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787862712.058379:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874709526444928:12345-0@lo:38:llog_process_th.0 Request processed in 70us (456us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787862712.058387:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862712.058485:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14346:1874709526445056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.058531:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862712.058562:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445056 00000100:00100000:0.0:1787862712.058566:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445056 00000100:00100000:0.0:1787862712.058593:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862712.058599:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14346:x1874709526445056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787862712.058839:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14346:x1874709526445056:12345-0@lo:502:llog_process_th.0 Request processed in 239us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.058846:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862712.058952:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509a496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.058975:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faead00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14346:1874709526445056:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787862712.059015:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1787862712.059232:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787862712.059239:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65081c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862712.059243:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787862712.059247:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526444928:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787862712.061389:0:14296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787862712.061423:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787862712.061451:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.061464:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c918a00/0x9c5536ccf8930d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d73 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787862712.061517:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787862712.061520:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862712.061521:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862712.061523:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862712.061524:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862712.061526:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862712.061527:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862712.061528:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862712.061531:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862712.061533:0:14296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787862712.061536:0:14296:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787862712.061538:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787862712.061540:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862712.061546:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862712.061546:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862712.061547:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862712.061548:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862712.061549:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862712.061550:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862712.061551:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862712.061552:0:14296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787862712.061580:0:14296:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787862712.061601:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526445184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787862712.061672:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.061714:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651cbf63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.061887:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445184 00000100:00100000:0.0:1787862712.061895:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445184 00000100:00100000:0.0:1787862712.061948:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787862712.061956:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14296:x1874709526445184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787862712.061996:0:14308:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787862712.062010:0:14308:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787862712.142929:0:14308:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787862712.143175:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787862712.148543:0:14330:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787862712.148555:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787862712.148707:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.148729:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.148739:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.148782:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.148797:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 12 pid: 14307 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.148813:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874709526445312:0@lo:104: 00000100:00100000:2.0:1787862712.148892:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.148956:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6511371d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862712.149173:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445312 00000100:00100000:0.0:1787862712.149181:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445312 00000100:00100000:0.0:1787862712.149219:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862712.149227:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14330:x1874709526445312:12345-0@lo:104: 00010000:00010000:0.0:1787862712.149240:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862712.149320:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787862712.149326:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14330:x1874709526445312:12345-0@lo:104: Request processed in 100us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862712.149333:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787862712.149413:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862712.149425:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149432:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919200 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862712.149436:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149445:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862712.149451:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862712.149457:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862712.149491:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149498:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862712.149518:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149525:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c919200/0x9c5536ccf8930d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d57 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149542:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862712.149544:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862712.149545:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862712.149571:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526445440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862712.149600:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862712.149688:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445440 00000100:00100000:2.0:1787862712.149696:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445440 00010000:00010000:2.0:1787862712.149719:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 13 pid: 14307 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862712.149740:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862712.149747:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+13:3284:x1874709526445440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862712.149758:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862712.149764:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 13 pid: 14307 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149774:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 13 pid: 14307 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149792:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149801:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787862712.149816:0:14299:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001263064s 00010000:00010000:2.0:1787862712.149821:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149828:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149835:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149842:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149856:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862712.149861:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149869:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149877:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862712.149888:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862712.149916:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+13:3284:x1874709526445440:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862712.149923:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862712.149972:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526445440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862712.150446:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422ca00/0x9c5536ccf8930d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930d50 expref: 12 pid: 14307 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862712.150459:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874709526445312:0@lo:104: 00010000:00010000:3.0:1787862712.150474:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862712.150482:0:14330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862712.150488:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862712.150494:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c918800/0x9c5536ccf8930d88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862712.156932:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14296:x1874709526445184:12345-0@lo:253:mount.lustre.0 Request processed in 94964us (95248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862712.156963:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787862712.157380:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14296:1874709526445184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787862712.157397:0:14296:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787862712.157401:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787862712.157404:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787862712.157405:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787862712.157406:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787862712.157408:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787862712.157409:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787862712.157412:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787862712.157413:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787862712.157415:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787862712.157416:0:14296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787862712.157439:0:14296:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787862712.166553:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862712.166857:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862712.167424:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862712.167590:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862712.168141:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862712.168454:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862712.169753:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862712.169903:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862712.170445:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862712.170663:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862712.171229:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862712.171400:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787862712.212529:0:14296:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787862712.212922:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787862712.213327:0:14354:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787862712.213396:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787862712.216395:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787862712.216526:0:14296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787862712.216928:0:14296:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787862712.216935:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787862712.217104:0:14296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787862712.219102:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787862712.219204:0:14354:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787862712.219209:0:14354:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1787862712.219969:0:14353:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787862712.219975:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787862712.221566:0:14296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787862712.222362:0:14296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787862712.222428:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787862712.225358:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787862712.230561:0:14296:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787862712.268748:0:14296:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787862712.268790:0:14296:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf1501cd7988 00100000:10000000:2.0:1787862712.268811:0:14296:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787862712.269527:0:14296:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787862712.269543:0:14296:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787862712.269556:0:14296:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787862712.269576:0:14296:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787862712.675454:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862713.057141:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787862713.181102:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787862713.181110:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a650ac37800 from 6 10000000:01000000:0.0:1787862713.181114:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787862713.181159:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862713.181170:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862713.181181:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862713.181206:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526445568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862713.181286:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862713.181332:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537f6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787862713.181399:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445568 00000100:00100000:2.0:1787862713.181406:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445568 00000100:00100000:2.0:1787862713.181466:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862713.181475:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14311:x1874709526445568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862713.181490:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862713.181504:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930d8f expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862713.181528:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862713.181539:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862713.181548:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00100000:2.0:1787862713.181589:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526445568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862713.181597:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862713.181637:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526445568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862713.181651:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862713.181660:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862713.181703:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526445696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787862713.181731:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862713.181751:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6511371480 going to sleep for 11 seconds 00000100:00100000:0.0:1787862713.181795:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445696 00000100:00100000:0.0:1787862713.181799:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445696 00000100:00100000:0.0:1787862713.181828:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787862713.181835:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526445696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787862713.181849:0:14307:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787862713.181863:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787862713.181866:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787862713.181946:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526445696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862713.181954:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862713.182083:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526445696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787862713.182119:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862713.182125:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862713.182134:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862713.692325:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862714.082311:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787862714.716339:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862715.741382:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862716.767308:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862717.084995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862717.085002:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787862717.085006:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862717.085009:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787862717.085012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787862717.085015:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787862717.085020:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a65081c4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862717.085033:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a65081c4800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862717.085082:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401a43840 x1874709526445952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862717.085124:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526445952:0@lo:38:kworker.0 00000100:00100000:1.0:1787862717.085194:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862717.085383:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526445824:0@lo:400:kworker.0 00000100:00100000:0.0:1787862717.097929:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862717.098058:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445824 00000100:00100000:0.0:1787862717.098067:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445824 00000100:00100000:0.0:1787862717.098117:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862717.098128:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:3281:x1874709526445824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862717.098185:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:3281:x1874709526445824:12345-0@lo:400:kworker.0 Request processed in 59us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862717.098192:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862717.098269:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526445824:0@lo:400:kworker.0 00000100:00100000:0.0:1787862717.098322:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526445952 00000100:00100000:0.0:1787862717.098326:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526445952 00000100:00100000:0.0:1787862717.098349:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862717.098354:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526445952:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787862717.098392:0:14316:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1787862717.098424:0:14316:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c5536ccf8930d9d 00000004:00100000:0.0:1787862717.098449:0:14316:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787862717.099442:0:14316:0:(import.c:65:import_set_state_nolock()) ffff9a65091a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862717.099676:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874709526445952:12345-0@lo:38:kworker.0 Request processed in 1318us (14480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862717.099685:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787862717.106894:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6401a43840 x1874709526445952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787862717.106918:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787862717.106927:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787862717.106932:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787862717.106956:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a65081c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787862717.106964:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874709526445952:0@lo:38:kworker.0 00000001:02000400:3.0:1787862717.528683:0:14596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787862717.796375:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862718.814403:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862719.839795:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862720.861131:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787862721.402475:0:14747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5bfffdf0 20000000:00000080:3.0:1787862721.402493:0:14747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a653f147800 uarg=0000000000000000 20000000:01000000:3.0:1787862721.402528:0:14747:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787862721.402536:0:14747:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787862721.402546:0:14747:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787862721.406882:0:14748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787862721.410838:0:14747:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787862721.421019:0:14747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787862721.421790:0:14747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.421811:0:14747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.421820:0:14747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.421863:0:14747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.421877:0:14747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 11 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862721.421892:0:14747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14747:1874709526446080:0@lo:104: 00000100:00100000:0.0:1787862721.421970:0:14747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862721.422034:0:14747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e21540 going to sleep for 11 seconds 00000100:00100000:2.0:1787862721.422215:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526446080 00000100:00100000:2.0:1787862721.422223:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526446080 00000100:00100000:2.0:1787862721.422263:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862721.422271:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14747:x1874709526446080:12345-0@lo:104: 00010000:00010000:2.0:1787862721.422284:0:14298:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422395:0:14298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862721.422402:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14747:x1874709526446080:12345-0@lo:104: Request processed in 132us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862721.422409:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787862721.422430:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862721.422435:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422443:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918400 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862721.422452:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422461:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862721.422468:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862721.422473:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787862721.422499:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422504:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862721.422521:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422528:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918400/0x9c5536ccf8930d5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d65 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422543:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862721.422545:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862721.422547:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862721.422563:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526446208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862721.422593:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862721.422626:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526446208 00000100:00100000:2.0:1787862721.422630:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526446208 00010000:00010000:2.0:1787862721.422646:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862721.422668:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862721.422683:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:3282:x1874709526446208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862721.422694:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862721.422700:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422709:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422724:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422730:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422743:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422749:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422755:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422762:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422768:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862721.422772:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422779:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422795:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862721.422804:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862721.422832:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:3282:x1874709526446208:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862721.422839:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787862721.422875:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526446208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787862721.423153:0:14747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534637400/0x9c5536ccf8930d65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930d5e expref: 11 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862721.423164:0:14747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14747:1874709526446080:0@lo:104: 00010000:00010000:0.0:1787862721.423176:0:14747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.423184:0:14747:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.423190:0:14747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862721.423197:0:14747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534636600/0x9c5536ccf8930da4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862721.884496:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787862722.204210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862722.204221:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787862722.204224:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862722.204228:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787862722.204299:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526446336:0@lo:400:kworker.0 00000100:00100000:2.0:1787862722.204380:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862722.204477:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526446336 00000100:00100000:2.0:1787862722.204484:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526446336 00000100:00100000:2.0:1787862722.204535:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787862722.204545:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526446336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862722.204600:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526446336:12345-0@lo:400:kworker.0 Request processed in 55us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862722.204607:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787862722.204861:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a64019f0000 x1874709526446336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862722.204876:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526446336:0@lo:400:kworker.0 00000100:00100000:1.0:1787862722.204977:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862712/real 1787862712] req@ffff9a64019f12c0 x1874709526443264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862722.204994:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a64019f12c0 x1874709526443264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862722.205003:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862712/real 1787862712] req@ffff9a64019f3c00 x1874709526443136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862722.205024:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a64019f3c00 x1874709526443136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787862722.205037:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862722.205074:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787862722.205078:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526443264:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787862722.205082:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787862722.205086:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787862722.205089:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526443136:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787862722.205167:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862722.205171:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787862722.205173:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787862722.205177:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1787862722.205181:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787862722.205186:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a651c1f5800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862722.205275:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64019f0000 x1874709526446464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787862722.205299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862722.205302:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787862722.205304:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787862722.205308:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1787862722.205311:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787862722.205315:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862722.205328:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64019f1680 x1874709526446592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862722.205456:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526446464:0@lo:8:kworker.0 00000400:00000100:1.0:1787862722.205486:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526446464 offset 0 length 520: 4 00000100:00100000:1.0:1787862722.205514:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526446592:0@lo:8:kworker.0 00000400:00000100:1.0:1787862722.205531:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874709526446592 offset 0 length 520: 4 00010000:00010000:2.0:1787862722.912723:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787862723.164178:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787862723.164215:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650ac37800 from 10 10000000:01000000:2.0:1787862723.164219:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787862723.164276:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862723.164288:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862723.164299:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862723.164337:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526446720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787862723.164413:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862723.164476:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c0583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862723.164580:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526446720 00000100:00100000:1.0:1787862723.164595:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526446720 00000100:00100000:1.0:1787862723.164651:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787862723.164672:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+11:14311:x1874709526446720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787862723.164686:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862723.164702:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930dab expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862723.164726:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862723.164737:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862723.164745:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78c00, rc 0) 00000100:00100000:1.0:1787862723.164799:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526446720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862723.164806:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862723.164898:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526446720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862723.164912:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862723.164921:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862723.164976:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526446848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862723.165003:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862723.165030:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c0583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862723.165107:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526446848 00000100:00100000:0.0:1787862723.165112:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526446848 00000100:00100000:0.0:1787862723.165145:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787862723.165152:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526446848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862723.165425:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526446848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862723.165432:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862723.165682:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526446848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862723.165720:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526446976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862723.165764:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862723.165802:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787862723.165854:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526446976 00000100:00100000:0.0:1787862723.165859:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526446976 00000100:00100000:0.0:1787862723.165888:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787862723.165895:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526446976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862723.166073:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14311:x1874709526446976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862723.166090:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862723.166232:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526446976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787862723.170458:0:14809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787862723.170712:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787862723.170737:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862723.170748:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862723.170760:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862723.937848:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862724.324945:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787862724.959271:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862725.980314:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862727.007347:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787862727.327478:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787862727.327488:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787862727.327492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787862727.327496:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787862727.327543:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862727.327574:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526447104:0@lo:400:kworker.0 00000100:00100000:0.0:1787862727.327694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862727.327768:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526447232:0@lo:400:kworker.0 00000100:00100000:0.0:1787862727.327809:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862727.327854:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447104 00000100:00100000:0.0:1787862727.327862:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447104 00000100:00100000:0.0:1787862727.327920:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862727.327931:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:3283:x1874709526447104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862727.327996:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:3283:x1874709526447104:12345-0@lo:400:kworker.0 Request processed in 65us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862727.328004:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787862727.328082:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447232 00000100:00100000:0.0:1787862727.328086:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447232 00000100:00100000:0.0:1787862727.328116:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862727.328135:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526447232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862727.328715:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526447232:12345-0@lo:400:kworker.0 Request processed in 578us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862727.328725:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862727.328789:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526447104:0@lo:400:kworker.0 00010000:00080000:2.0:1787862727.329918:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a651fae9a40 x1874709526447232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862727.329940:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526447232:0@lo:400:kworker.0 00010000:00010000:2.0:1787862728.033390:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787862729.028968:0:14997:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787862729.028973:0:14997:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787862729.029201:0:14997:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a650610b000 00000020:01000004:0.0:1787862729.029224:0:14997:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787862729.029241:0:14997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787862729.029259:0:14997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a651c9d1a48) 00000020:00000080:0.0:1787862729.029280:0:14997:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787862729.054901:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787862729.149178:0:14997:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787862729.149634:0:14997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787862729.155961:0:14997:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787862729.156546:0:14997:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787862729.163927:0:14997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787862729.165396:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787862729.165607:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787862729.166035:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787862729.168279:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 718: rc = 0 00100000:10000000:2.0:1787862729.169326:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 718: rc = 0 00100000:10000000:2.0:1787862729.171023:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 718: rc = 0 00100000:10000000:2.0:1787862729.171505:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 718: rc = 0 00100000:10000000:2.0:1787862729.173647:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 718: rc = 0 00100000:10000000:2.0:1787862729.174274:0:14997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 718: rc = 0 00000020:00000080:2.0:1787862729.175315:0:14997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787862729.175329:0:14997:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787862729.175472:0:14997:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c5536ccf8930dc0 00000020:01000004:2.0:1787862729.175483:0:14997:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787862729.175506:0:14997:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787862729.175510:0:14997:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787862729.175516:0:14997:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787862729.175521:0:14997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787862729.175532:0:14997:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a65401c9a48) 00000020:00000080:2.0:1787862729.175542:0:14997:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787862729.180073:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787862729.180284:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787862729.180291:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787862729.181797:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787862729.181809:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787862729.182109:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787862729.182116:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787862729.189489:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862729.189937:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787862729.189943:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787862729.195577:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787862729.195591:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787862729.223549:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862729.223970:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787862729.223977:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787862729.226931:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787862729.226950:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787862729.229677:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787862729.229691:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787862729.233977:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787862729.234576:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787862729.234595:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787862729.252302:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787862729.252320:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787862729.336596:0:14997:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787862729.336800:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787862729.336807:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787862729.341836:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787862729.341850:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787862729.342957:0:14997:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787862729.342983:0:14997:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787862729.342990:0:14997:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787862729.375582:0:14997:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787862729.375621:0:14997:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.160@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787862729.375625:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787862729.375627:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787862729.375628:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862729.375629:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862729.375630:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862729.375632:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862729.375633:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862729.375635:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862729.375636:0:14997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787862729.375639:0:14997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787862729.375641:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787862729.375642:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787862729.375643:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862729.375644:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862729.375645:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862729.375646:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862729.375647:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862729.375648:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862729.375649:0:14997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787862729.375685:0:14997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787862729.375705:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447360:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787862729.375780:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862729.375827:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862729.375914:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447360 00000100:00100000:2.0:1787862729.375922:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447360 00000100:00100000:2.0:1787862729.375982:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787862729.375992:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14997:x1874709526447360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787862729.376032:0:14308:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787862729.376035:0:14308:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787862729.376039:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787862729.397157:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14997:x1874709526447360:12345-0@lo:253:mount.lustre.0 Request processed in 21159us (21368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862729.397173:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862729.397336:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787862729.397352:0:14997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787862729.397356:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787862729.397358:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787862729.397359:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787862729.397361:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787862729.397378:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787862729.397379:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787862729.397380:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787862729.397382:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787862729.397384:0:14997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787862729.397406:0:14997:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a650610b000 from lustre-OST0000 10000000:01000000:1.0:1787862729.397433:0:14997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787862729.397436:0:14997:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787862729.397443:0:14997:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6533eeb490 local copy 00010000:00010000:1.0:1787862729.397453:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862729.397683:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862729.397720:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862729.397747:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862729.397871:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447488 00000100:00100000:0.0:1787862729.397878:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447488 00000100:00100000:0.0:1787862729.397924:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787862729.397933:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14997:x1874709526447488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787862729.398109:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14997:x1874709526447488:12345-0@lo:501:mount.lustre.0 Request processed in 177us (388us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787862729.398118:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862729.398204:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447488:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787862729.398227:0:14997:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787862729.398396:0:14997:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787862729.398404:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.398415:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862729.398439:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a650610b000 10000000:01000000:2.0:1787862729.398444:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787862729.398448:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a6533eeb490 10000000:01000000:2.0:1787862729.398452:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787862729.398455:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a6533eeb490 from 1 10000000:01000000:2.0:1787862729.398458:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787862729.398483:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.398492:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.398502:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862729.398515:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862729.398546:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.398576:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.398746:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447616 00000100:00100000:1.0:1787862729.398751:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447616 00000100:00100000:1.0:1787862729.398786:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862729.398794:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+12:14997:x1874709526447616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862729.398804:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862729.398819:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b79600/0x9c5536ccf8930dd5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930dce expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.398841:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b79600/0x9c5536ccf8930dd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930dce expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.398852:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b79600/0x9c5536ccf8930dd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930dce expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.398862:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79600, rc 0) 00000100:00100000:1.0:1787862729.398890:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+13:14997:x1874709526447616:12345-0@lo:101:mount.lustre.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.398903:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862729.399109:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862729.399122:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.399143:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862729.399169:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787862729.399188:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.399195:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c918c00/0x9c5536ccf8930dce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930dd5 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862729.399201:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787862729.399204:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862729.399215:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787862729.399217:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787862729.399232:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.399239:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.399247:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862729.399261:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862729.399289:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.399317:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.399461:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447744 00000100:00100000:1.0:1787862729.399466:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447744 00000100:00100000:1.0:1787862729.399496:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787862729.399502:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+13:14997:x1874709526447744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862729.399509:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862729.399517:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b78a00/0x9c5536ccf8930de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930ddc expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.399530:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b78a00/0x9c5536ccf8930de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930ddc expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.399538:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b78a00/0x9c5536ccf8930de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930ddc expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.399545:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b78a00, rc 0) 00000100:00100000:1.0:1787862729.399574:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526447744:12345-0@lo:101:mount.lustre.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.399580:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787862729.399924:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862729.399936:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.399944:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862729.402098:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787862729.402992:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862729.403285:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787862729.403322:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787862729.404640:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787862729.404730:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787862729.404770:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787862729.404801:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787862729.405525:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787862729.405538:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787862729.405665:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862729.405751:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.405803:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787862729.405999:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526447872 00000100:00100000:2.0:1787862729.406008:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526447872 00000100:00100000:2.0:1787862729.406149:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787862729.406161:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526447872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862729.406579:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526447872:12345-0@lo:501:mount.lustre.0 Request processed in 420us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862729.406588:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787862729.406686:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526447872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862729.406747:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862729.406786:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.413760:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.418199:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448000 00000100:00100000:1.0:1787862729.421520:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448000 00000100:00100000:1.0:1787862729.423257:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862729.423276:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862729.423798:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448000:12345-0@lo:503:mount.lustre.0 Request processed in 525us (17009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.423808:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787862729.424250:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787862729.424935:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862729.425037:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862729.425143:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.425177:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862729.425365:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448128 00000100:00100000:0.0:1787862729.425378:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448128 00000100:00100000:0.0:1787862729.425430:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862729.425440:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862729.425666:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448128:12345-0@lo:502:mount.lustre.0 Request processed in 227us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862729.425675:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787862729.426525:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862729.426838:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787862729.426896:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787862729.426946:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787862729.426997:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787862729.427032:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787862729.427099:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787862729.427161:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787862729.427197:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787862729.427483:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787862729.427537:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787862729.427575:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787862729.427623:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787862729.427665:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862729.427728:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.427814:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862729.438645:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448256 00000100:00100000:0.0:1787862729.438665:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448256 00000100:00100000:0.0:1787862729.438733:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787862729.438746:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862729.439134:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448256:12345-0@lo:502:mount.lustre.0 Request processed in 381us (11395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862729.439143:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787862729.439398:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862729.439545:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787862729.439573:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787862729.447485:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787862729.447506:0:15011:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787862729.447516:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.447518:0:15011:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787862729.447525:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787862729.447552:0:15011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6403289a48) 00000020:00000080:3.0:1787862729.447585:0:15011:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787862729.447592:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787862729.447704:0:15011:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650610b000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787862729.447715:0:15011:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787862729.447726:0:15011:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c5536ccf8930df1 00010000:00010000:2.0:1787862729.457637:0:15011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787862729.459469:0:15011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787862729.467921:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1787862729.480440:0:15011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787862729.480455:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862729.480465:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862729.480467:0:15011:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787862729.480472:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787862729.480476:0:15011:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787862729.480478:0:15011:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787862729.480479:0:15011:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787862729.480481:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787862729.480484:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862729.480485:0:15011:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787862729.480488:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862729.480491:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862729.480492:0:15011:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787862729.480496:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787862729.480498:0:15011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787862729.480500:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862729.480511:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862729.480513:0:15011:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787862729.480516:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787862729.480519:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862729.480520:0:15011:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787862729.480524:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787862729.480566:0:15011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787862729.480569:0:15011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787862729.480571:0:15011:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787862729.480574:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787862729.480902:0:14997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787862729.480930:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787862729.480959:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.480972:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c919c00/0x9c5536ccf8930ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930de3 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862729.480980:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650610b000 from 1 10000000:01000000:3.0:1787862729.480983:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862729.481022:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.481030:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.481061:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862729.481088:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787862729.481183:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.481526:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448384 00000100:00100000:3.0:1787862729.481533:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448384 00000100:00100000:3.0:1787862729.481593:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787862729.481603:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+14:14997:x1874709526448384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862729.481616:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862729.481628:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930df8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.481651:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.481663:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.481688:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c800, rc 0) 00000100:00100000:3.0:1787862729.481722:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448384:12345-0@lo:101:mount.lustre.0 Request processed in 121us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.481729:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787862729.481773:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640327b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862729.481794:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862729.481809:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.481817:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862729.482360:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787862729.482707:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862729.482948:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787862729.482994:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787862729.483090:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787862729.483099:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787862729.483174:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862729.483231:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.483263:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862729.484076:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448512 00000100:00100000:0.0:1787862729.484085:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448512 00000100:00100000:1.0:1787862729.484177:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787862729.484201:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862729.486167:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448512:12345-0@lo:501:mount.lustre.0 Request processed in 1964us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.486180:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787862729.486181:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787862729.486252:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862729.486312:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.486354:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.486476:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448640 00000100:00100000:1.0:1787862729.486483:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448640 00000100:00100000:1.0:1787862729.486534:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787862729.486552:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862729.486740:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448640:12345-0@lo:503:mount.lustre.0 Request processed in 198us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.486748:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862729.487257:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787862729.487921:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862729.488002:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862729.488094:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862729.488137:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650634f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787862729.488161:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448768 00000100:00100000:3.0:1787862729.488166:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448768 00000100:00100000:3.0:1787862729.488215:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787862729.488223:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862729.488394:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448768:12345-0@lo:502:mount.lustre.0 Request processed in 171us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.488402:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862729.488425:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787862729.488651:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787862729.488701:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787862729.488752:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787862729.488790:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787862729.488838:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787862729.489023:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787862729.489102:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787862729.489152:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787862729.489185:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862729.489282:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862729.489309:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65117a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862729.489373:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526448896 00000100:00100000:3.0:1787862729.489378:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526448896 00000100:00100000:3.0:1787862729.489415:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787862729.489423:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862729.489575:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526448896:12345-0@lo:502:mount.lustre.0 Request processed in 153us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.489582:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787862729.490220:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526448896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787862729.490324:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787862729.490335:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787862729.491569:0:15014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862729.491775:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.491778:0:15014:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787862729.491785:0:15014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a650610b000 00000020:00000080:3.0:1787862729.491788:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862729.491796:0:15014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862729.491798:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.491800:0:15014:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787862729.491802:0:15014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862729.491805:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.491806:0:15014:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787862729.491810:0:15014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a650610b000 00000020:00000080:3.0:1787862729.491812:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862729.492310:0:15014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862729.492314:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.492316:0:15014:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787862729.492319:0:15014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787862729.492321:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.492323:0:15014:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787862729.492327:0:15014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a650610b000 00000020:00000080:3.0:1787862729.492329:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787862729.492375:0:15014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787862729.492379:0:15014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862729.492380:0:15014:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787862729.492382:0:15014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787862729.492676:0:14997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787862729.492705:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787862729.492729:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.492741:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862729.492791:0:14997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787862729.492795:0:14997:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a650610b000 10000000:01000000:2.0:1787862729.492803:0:14997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a650610b000 10000000:01000000:2.0:1787862729.492807:0:14997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787862729.492814:0:14997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a650610b000 from 1 10000000:01000000:2.0:1787862729.492817:0:14997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787862729.492875:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.492883:0:14997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.492896:0:14997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862729.492923:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787862729.493006:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862729.493063:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449024 00000100:00100000:2.0:1787862729.493069:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.493070:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449024 00000100:00100000:1.0:1787862729.493118:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787862729.493138:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526449024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787862729.493152:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862729.493164:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6401b79e00/0x9c5536ccf8930e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930e06 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.493188:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6401b79e00/0x9c5536ccf8930e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930e06 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.493199:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6401b79e00/0x9c5536ccf8930e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930e06 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.493487:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6401b79e00, rc 0) 00000100:00100000:2.0:1787862729.493614:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862729.493629:0:14997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.493639:0:14997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862729.494348:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787862729.494693:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787862729.494963:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787862729.495007:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787862729.495060:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787862729.495110:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787862729.495160:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787862729.495223:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787862729.495259:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787862729.495293:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787862729.495341:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787862729.495393:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787862729.495426:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787862729.495473:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787862729.495508:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787862729.495559:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787862729.495624:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787862729.495663:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787862729.495694:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787862729.495740:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787862729.495777:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787862729.495811:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787862729.495871:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787862729.495906:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787862729.495940:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787862729.495989:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787862729.496022:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787862729.496080:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787862729.496140:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787862729.496177:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787862729.496249:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787862729.496257:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787862729.496364:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862729.509327:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.509389:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862729.509860:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449152 00000100:00100000:3.0:1787862729.509871:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449152 00000100:00100000:3.0:1787862729.509934:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787862729.509944:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14997:x1874709526449152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862729.510300:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14997:x1874709526449152:12345-0@lo:501:mount.lustre.0 Request processed in 357us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.510309:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787862729.512762:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862729.512862:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862729.512960:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.513015:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862729.513094:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449280 00000100:00100000:3.0:1787862729.513108:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449280 00000100:00100000:3.0:1787862729.513174:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787862729.513185:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14997:x1874709526449280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862729.513388:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14997:x1874709526449280:12345-0@lo:503:mount.lustre.0 Request processed in 205us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.513396:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787862729.513533:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787862729.514747:0:14997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787862729.514791:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14997:x1874709526449024:12345-0@lo:101:mount.lustre.0 Request processed in 21543us (21663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.514802:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787862729.516379:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862729.518810:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.518863:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787862729.519110:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449408 00000100:00100000:2.0:1787862729.519120:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449408 00000100:00100000:2.0:1787862729.519186:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862729.519195:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14997:x1874709526449408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862729.521323:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14997:x1874709526449408:12345-0@lo:502:mount.lustre.0 Request processed in 2120us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862729.521346:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862729.522317:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787862729.522665:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787862729.522726:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787862729.522759:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787862729.522806:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787862729.522844:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787862729.522924:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787862729.522962:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787862729.522994:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787862729.523039:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787862729.523093:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787862729.523138:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787862729.523197:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787862729.523233:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787862729.523278:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787862729.523325:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787862729.523357:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787862729.523388:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787862729.523435:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787862729.523477:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787862729.523509:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787862729.523569:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787862729.523607:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787862729.523640:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787862729.523687:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787862729.523720:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787862729.523755:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787862729.523799:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787862729.523834:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787862729.523865:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787862729.523922:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787862729.523957:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787862729.523989:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787862729.524022:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787862729.524090:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787862729.524139:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787862729.524189:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787862729.524226:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787862729.524258:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787862729.524304:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787862729.524340:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787862729.524386:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862729.524465:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.524517:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.528179:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449536 00000100:00100000:1.0:1787862729.528202:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449536 00000100:00100000:1.0:1787862729.528592:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787862729.528604:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14997:x1874709526449536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862729.532429:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14997:x1874709526449536:12345-0@lo:502:mount.lustre.0 Request processed in 3816us (7952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.532444:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787862729.532461:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787862729.532637:0:14997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787862729.532655:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787862729.546192:0:15018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787862729.546240:0:15018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a6403270000) 00000020:00000080:2.0:1787862729.546263:0:15018:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787862729.546354:0:15018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650610b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787862729.546358:0:15018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650610b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787862729.546361:0:15018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650610b000 3 00010000:00080000:2.0:1787862729.546392:0:15018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a653e4b3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.160@tcp at head 00010000:00010000:2.0:1787862729.549905:0:15018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787862729.550181:0:15018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787862729.550226:0:15018:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787862729.550242:0:15018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c5536ccf8930e1b 00000100:00080000:2.0:1787862729.550254:0:15018:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787862729.550260:0:15018:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a653e4b3000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:2.0:1787862729.550299:0:15018:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64019f2580 x1874709526449664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787862729.550359:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526449664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787862729.550440:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.550512:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449664 00000100:00100000:2.0:1787862729.550519:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449664 00000100:00100000:2.0:1787862729.550561:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862729.550569:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874709526449664:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787862729.550596:0:14316:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1787862729.550632:0:14316:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c5536ccf8930e22 00000004:00100000:2.0:1787862729.550650:0:14316:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787862729.550682:0:14316:0:(import.c:65:import_set_state_nolock()) ffff9a650741e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862729.550732:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874709526449664:12345-0@lo:38:llog_process_th.0 Request processed in 162us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862729.550740:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787862729.550776:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a64019f2580 x1874709526449664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862729.550801:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787862729.550809:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787862729.550816:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787862729.550820:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787862729.550822:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653e4b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787862729.550827:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874709526449664:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787862729.550848:0:15018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787862729.551074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862729.551081:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787862729.551084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862729.551088:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787862729.551146:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862729.551156:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526449792:0@lo:400:kworker.0 00000100:00100000:3.0:1787862729.551198:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.551242:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449792 00000100:00100000:3.0:1787862729.551246:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449792 00000100:00100000:3.0:1787862729.551274:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862729.551280:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526449792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862729.551316:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526449792:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862729.551321:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787862729.551345:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a64031dc780 x1874709526449792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862729.551355:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526449792:0@lo:400:kworker.0 00000040:00080000:0.0:1787862729.564719:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787862729.564868:0:14997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787862729.564908:0:14997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862729.564930:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862729.564943:0:14997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a651c919600/0x9c5536ccf8930e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e0d expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787862729.564999:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787862729.565002:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862729.565003:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862729.565004:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862729.565005:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862729.565006:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862729.565008:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862729.565009:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862729.565011:0:14997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787862729.565015:0:14997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787862729.565018:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787862729.565019:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862729.565020:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862729.565021:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862729.565022:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862729.565023:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862729.565025:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862729.565026:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862729.565026:0:14997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787862729.565073:0:14997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787862729.565094:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449920:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787862729.565181:0:14997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862729.565222:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537f6a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862729.565253:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526449920 00000100:00100000:0.0:1787862729.565259:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526449920 00000100:00100000:0.0:1787862729.565302:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862729.565310:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14997:x1874709526449920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787862729.565348:0:14308:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787862729.565362:0:14308:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787862729.695801:0:14308:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787862729.695824:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787862729.695883:0:14330:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787862729.695889:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787862729.695912:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.695930:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.695939:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.695980:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.695995:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 16 pid: 14309 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862729.696011:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874709526450048:0@lo:104: 00000100:00100000:3.0:1787862729.696141:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862729.696188:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862729.696679:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450048 00000100:00100000:1.0:1787862729.696687:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450048 00000100:00100000:1.0:1787862729.696740:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862729.696750:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14330:x1874709526450048:12345-0@lo:104: 00010000:00010000:1.0:1787862729.696764:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862729.696838:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787862729.696845:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14330:x1874709526450048:12345-0@lo:104: Request processed in 96us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.696852:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862729.699286:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dc780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874709526450048:0@lo:104: 00010000:00010000:3.0:1787862729.699319:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.699930:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862729.699939:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.699949:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:2.0:1787862729.699954:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.699964:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787862729.699971:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787862729.699976:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787862729.700029:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700036:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787862729.700083:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700109:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a6534637600/0x9c5536ccf8930d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930d96 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700135:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862729.700137:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862729.700139:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862729.700157:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862729.700174:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526450176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787862729.700251:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862729.700313:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450176 00000100:00100000:2.0:1787862729.700320:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450176 00010000:00010000:2.0:1787862729.700349:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 17 pid: 14309 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862729.700380:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862729.700389:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:3284:x1874709526450176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787862729.700403:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862729.700408:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 17 pid: 14309 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700418:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 17 pid: 14309 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700432:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919000/0x9c5536ccf8930d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930d8f expref: 17 pid: 14309 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700447:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700466:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787862729.700482:0:14299:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004593328s 00010000:00010000:2.0:1787862729.700487:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700494:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700501:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700507:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700512:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422de00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862729.700516:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700523:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700536:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862729.700560:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862729.700594:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3284:x1874709526450176:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862729.700602:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862729.700645:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526450176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862729.701698:0:14330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.701711:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862729.701718:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422de00/0x9c5536ccf8930e29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862729.726160:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14997:x1874709526449920:12345-0@lo:253:mount.lustre.0 Request processed in 160838us (160966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862729.726195:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862729.726318:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14997:1874709526449920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787862729.726333:0:14997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787862729.726336:0:14997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862729.726337:0:14997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787862729.726339:0:14997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862729.726340:0:14997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862729.726341:0:14997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862729.726342:0:14997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862729.726343:0:14997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862729.726345:0:14997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862729.726346:0:14997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787862729.726360:0:14997:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787862729.729725:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862729.729885:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862729.730034:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862729.733100:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787862729.733395:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1787862729.733627:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787862729.734967:0:14997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787862729.916516:0:14997:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787862729.916527:0:14997:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787862729.916635:0:14997:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787862729.916698:0:14997:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787862729.916712:0:14997:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787862729.921219:0:14997:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787862730.080579:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862731.101261:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787862731.228445:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787862731.228455:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a650ac37800 from 7 10000000:01000000:3.0:1787862731.228461:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787862731.228524:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862731.228539:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862731.228731:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862731.228765:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031de940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526450304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862731.228874:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862731.228946:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6509fc10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862731.228985:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450304 00000100:00100000:0.0:1787862731.228992:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450304 00000100:00100000:0.0:1787862731.229084:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862731.229099:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+15:14311:x1874709526450304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862731.229127:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862731.229142:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930e30 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862731.229174:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862731.229185:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862731.229193:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636000, rc 0) 00000100:00100000:0.0:1787862731.229237:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14311:x1874709526450304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862731.229244:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862731.229305:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031de940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526450304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862731.229322:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862731.229331:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862731.229396:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526450432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787862731.229431:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862731.229454:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6537e21900 going to sleep for 11 seconds 00000100:00100000:1.0:1787862731.229941:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450432 00000100:00100000:1.0:1787862731.229948:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450432 00000100:00100000:1.0:1787862731.229987:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787862731.229997:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14311:x1874709526450432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787862731.230011:0:14308:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787862731.230029:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787862731.230032:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787862731.232238:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14311:x1874709526450432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2233us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862731.232254:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787862731.232912:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526450432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787862731.232999:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787862731.233013:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862731.233024:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862732.127335:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862733.148574:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862734.177228:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862734.558350:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787862735.005639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862735.005650:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787862735.005653:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787862735.005657:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787862735.005707:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526450560:0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.005815:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862735.005893:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526450688:0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.005921:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862735.005942:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862735.005947:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526450816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.005969:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862735.006002:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450560 00000100:00100000:2.0:1787862735.006011:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450560 00000100:00100000:2.0:1787862735.006101:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787862735.006112:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3284:x1874709526450560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.006176:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3284:x1874709526450560:12345-0@lo:400:kworker.0 Request processed in 66us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862735.006184:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787862735.006224:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450688 00000100:00100000:2.0:1787862735.006227:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450688 00000100:00100000:2.0:1787862735.006271:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450816 00000100:00100000:2.0:1787862735.006275:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450816 00000100:00100000:2.0:1787862735.006310:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862735.006316:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526450688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.006355:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526450688:12345-0@lo:400:kworker.0 Request processed in 39us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862735.006361:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862735.006372:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787862735.006378:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526450816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.006404:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526450816:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862735.006410:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787862735.006456:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64019f0b40 x1874709526450816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862735.006470:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526450816:0@lo:400:kworker.0 00010000:00080000:2.0:1787862735.006481:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64019f12c0 x1874709526450688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862735.006490:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526450688:0@lo:400:kworker.0 00000100:00100000:2.0:1787862735.006517:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526450560:0@lo:400:kworker.0 00000100:00080000:0.0:1787862735.013428:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787862735.197603:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862736.222254:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.244237:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862737.757629:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862722/real 1787862722] req@ffff9a64019f0000 x1874709526446464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862737.757666:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a64019f0000 x1874709526446464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862737.757697:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787862722/real 1787862722] req@ffff9a64019f1680 x1874709526446592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862737.757712:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a64019f1680 x1874709526446592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787862737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787862737.757732:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787862737.762323:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787862737.762336:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526446464:0@lo:8:kworker.0 00000100:00080000:2.0:1787862737.766879:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787862737.779483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862737.779489:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787862737.779493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862737.779501:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1787862737.779518:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787862737.779525:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a651c1f5800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787862737.779533:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862737.779549:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526450944:0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.779621:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862737.779684:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526450944 00000100:00100000:3.0:1787862737.779690:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526450944 00000100:00100000:3.0:1787862737.779736:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787862737.779743:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3284:x1874709526450944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.779788:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3284:x1874709526450944:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862737.779795:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787862737.779838:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526450944:0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.779871:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64031dfc00 x1874709526451072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787862737.779884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787862737.779888:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787862737.779890:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787862737.779893:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1787862737.779896:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787862737.779899:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787862737.779908:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64031dc000 x1874709526451200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787862737.779928:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526451328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.779951:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862737.779989:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451328 00000100:00100000:3.0:1787862737.779993:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451328 00000100:00100000:3.0:1787862737.780034:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862737.780069:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526451328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.780105:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526451328:12345-0@lo:400:kworker.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862737.780111:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787862737.780134:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64031de580 x1874709526451328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862737.780145:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526451328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.780180:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526451456:0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.780206:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862737.780231:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451456 00000100:00100000:3.0:1787862737.780234:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451456 00000100:00100000:3.0:1787862737.780554:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862737.780560:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862737.780592:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526451456:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862737.780597:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787862737.780612:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787862737.780628:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64031de580 x1874709526451456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862737.780638:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526451456:0@lo:400:kworker.0 00000100:00080000:2.0:1787862737.783217:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787862737.783231:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526446592:0@lo:8:kworker.0 00000100:00100000:3.0:1787862737.783812:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526451072:0@lo:8:kworker.0 00000100:00100000:3.0:1787862737.783916:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862737.783987:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526451200:0@lo:8:kworker.0 00000100:00100000:0.0:1787862737.784395:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451072 00000100:00100000:0.0:1787862737.784410:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451072 00000100:00100000:0.0:1787862737.784453:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862737.784462:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526451072:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787862737.784492:0:14998:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1787862737.784529:0:14998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf8930e3e 00002000:00100000:0.0:1787862737.784546:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a6534623800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787862737.784551:0:14998:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787862737.784554:0:14998:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787862737.784929:0:14998:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787862737.784957:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a6534624000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862737.785013:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874709526451072:12345-0@lo:8:kworker.0 Request processed in 549us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862737.785021:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787862737.786482:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787862737.786577:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64031dfc00 x1874709526451072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862737.786590:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787862737.786599:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787862737.786608:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787862737.786613:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787862737.786616:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a651c1f5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787862737.786629:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787862737.786635:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526451072:0@lo:8:kworker.0 00000004:00080000:3.0:1787862737.786684:0:14338:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787862737.786702:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14338:1874709526451712:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787862737.786741:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862737.786770:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058480 going to sleep for 11 seconds 00000100:00100000:3.0:1787862737.786788:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526451584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862737.786814:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862737.786850:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451200 00000100:00100000:3.0:1787862737.786856:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451200 00000100:00100000:3.0:1787862737.786874:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451712 00000100:00100000:3.0:1787862737.786877:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451712 00000100:00100000:3.0:1787862737.786976:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862737.786983:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526451200:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787862737.787001:0:14998:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:1.0:1787862737.788905:0:14337:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787862737.789571:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451584 00000100:00100000:0.0:1787862737.789581:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451584 00000100:00100000:0.0:1787862737.789624:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862737.789633:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526451584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862737.789665:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862737.789736:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526451584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862737.789744:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1787862737.790583:0:14337:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463554537807ns, next at 0ns, rc = 0 00000100:00080000:2.0:1787862737.808215:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787862737.848569:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64031dd2c0 x1874709526451584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787862737.848598:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526451584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862737.866230:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526451200:12345-0@lo:8:kworker.0 Request processed in 79239us (82182us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787862737.866259:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862737.866292:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787862737.866306:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14338:x1874709526451712:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1787862737.868097:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787862737.868110:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787862737.868116:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526451200:0@lo:8:kworker.0 00002000:00080000:3.0:1787862737.903563:0:14998:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787862737.903578:0:14998:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787862737.903584:0:14998:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000004:00080000:3.0:1787862737.931181:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787862737.931684:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.931694:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.931712:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.931717:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.931725:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.931743:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.931755:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.931763:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.931787:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862737.936180:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.936196:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.936212:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.936217:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.936257:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.936288:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.936297:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf8930e45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.936346:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.936348:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.936350:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862737.940723:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.940734:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.941018:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.941024:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.941032:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.941230:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.941576:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.941586:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.941615:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862737.942163:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.942173:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.942183:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.942187:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.942197:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.942215:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.942251:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bccb5d6/0x9c5536ccf8930e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.942275:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.942277:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.942278:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862737.942560:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.942566:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.942577:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.942581:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.942586:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.942606:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.942614:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.942621:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.942645:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862737.943150:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.943157:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943165:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.943168:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.943172:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943181:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943188:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943205:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943225:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787862737.943239:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862737.943243:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943252:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862737.943255:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943264:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943277:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943284:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6a3ff6/0x9c5536ccf8930e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943298:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862737.943302:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943319:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862737.943323:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943330:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943340:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943347:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943360:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862737.943362:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862737.943363:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862737.943775:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.943782:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943791:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.943794:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.943798:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943808:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943823:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943830:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943846:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862737.943856:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862737.943859:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943865:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862737.943869:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943876:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943886:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943893:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930e61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.943905:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862737.943912:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862737.943914:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.944702:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862737.945845:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.945856:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.945871:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.945875:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.945880:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.945904:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.945916:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.945923:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.945998:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787862737.951807:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862737.951825:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.951846:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862737.951851:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862737.951858:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.951882:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.952075:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862737.952085:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952446:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862737.952455:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952465:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.952470:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952479:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952498:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952506:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024b98e7b/0x9c5536ccf8930e68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952537:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.952541:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952556:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422dc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.952559:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952567:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952578:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952588:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.952589:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.952592:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862737.952652:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787862737.952657:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.952829:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.959011:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.959026:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.959684:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.959691:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.959710:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.959727:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.959739:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960406:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960444:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862737.960466:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862737.960472:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960480:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862737.960485:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960495:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960513:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960533:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.960555:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.960557:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.960559:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.962468:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.962481:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962497:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.962502:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.962508:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962521:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962530:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962537:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962565:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862737.962582:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862737.962594:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962601:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862737.962605:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962613:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962628:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962636:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930e7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.962654:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.962655:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.962657:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.964722:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.964736:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.965138:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.965143:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.965150:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.965178:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.965188:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.965197:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.965219:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862737.965500:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.965509:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.965518:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.965522:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.965531:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.965548:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.965562:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8930e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.965581:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.965583:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.965584:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.968901:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.968917:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.968935:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.968940:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.968947:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.968961:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.968973:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.968994:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.969016:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862737.969030:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862737.969036:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.969851:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862737.969857:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.969867:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.969886:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.969894:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009861c672/0x9c5536ccf8930e8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.969916:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.969918:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.969921:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.972005:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.972025:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.972071:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.972076:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.972084:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.972098:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.972108:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.972116:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.972137:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862737.977417:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.977430:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.977443:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.977447:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.977457:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.977478:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.977485:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f767345b/0x9c5536ccf8930e92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.977503:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.977505:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.977507:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.978127:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.978138:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.978152:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.978157:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.978164:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.978178:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.978195:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.978203:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.978233:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862737.979234:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862737.979482:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862737.979490:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.979500:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862737.979504:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.979514:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.979540:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.979545:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.979548:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.979552:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862737.979554:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f00a887/0x9c5536ccf8930e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.979557:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.979567:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.979573:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862737.979575:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.979576:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.979577:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.979583:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.979617:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862737.979825:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.979832:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.979841:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.979845:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.979854:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.979866:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.979873:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006071534e/0x9c5536ccf8930ea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.979888:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.979890:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.979892:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.980643:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.980652:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.980663:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.980667:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.980672:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.980683:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.980692:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.980700:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.980721:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862737.980775:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862737.980781:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.980788:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636e00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862737.980792:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.980800:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.980813:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.980820:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d04bdef/0x9c5536ccf8930ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862737.980848:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862737.980850:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862737.980852:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862737.986619:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.986633:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.986653:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.986665:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.986672:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.986686:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.986695:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.986703:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.987249:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862737.988520:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.988531:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.988546:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.988551:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.988557:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.988568:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.988578:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.988591:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.988920:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862737.988929:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.988938:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.988942:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.988964:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.988986:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.988994:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099055d82/0x9c5536ccf8930eae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.989022:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862737.989025:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.989031:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862737.989034:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.989081:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.989093:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862737.989100:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.989102:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862737.989109:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862737.992577:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787862737.992591:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd44791d/0x9c5536ccf8930eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787862737.993278:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862737.993287:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.993300:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862737.996520:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862737.996539:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.996560:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.996573:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862737.996581:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.001459:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.001476:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.001491:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.001496:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.001508:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.001530:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.001544:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.001546:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.001548:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862738.001848:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787862738.001856:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099012e84/0x9c5536ccf8930ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.002493:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862738.005667:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862738.005681:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.005699:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862738.005705:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862738.005712:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.005726:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.005735:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.005812:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.005874:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787862738.006454:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862738.006460:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.006476:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1787862738.006479:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862738.006484:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.006494:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.006503:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862738.006510:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.006972:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787862738.006981:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.006990:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.006995:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007004:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007030:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007037:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f7d3ed/0x9c5536ccf8930ec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007091:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.007094:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007102:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.007105:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007113:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007123:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007130:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.007132:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.007133:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862738.007492:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787862738.007499:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005150f741/0x9c5536ccf8930eca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.007968:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862738.010763:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862738.010776:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.010793:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862738.010798:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862738.010805:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.010819:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.010842:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.010850:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.010876:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862738.011706:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.011715:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.011731:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422dc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.011735:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.011755:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.011774:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.011782:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001201ebe9/0x9c5536ccf8930ed1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.011800:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.011802:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.011804:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862738.012155:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862738.012162:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.012171:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862738.012175:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862738.012180:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.012190:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.012198:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.012206:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.012452:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862738.012848:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.012855:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.012864:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.012867:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.012876:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.012898:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.012905:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c61027/0x9c5536ccf8930ed8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.013027:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.013029:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.013031:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787862738.014617:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787862738.014629:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014644:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787862738.014648:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862738.014655:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014667:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014679:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014687:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014717:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862738.014729:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.014734:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014741:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.014822:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014831:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014847:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014854:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777789c8/0x9c5536ccf8930edf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.014870:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.014871:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.014873:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787862738.016017:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787862738.016026:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016036:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787862738.016076:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862738.016083:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016095:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016104:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016111:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016126:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787862738.016138:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.016142:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016149:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.016152:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016160:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016173:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016191:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea690738/0x9c5536ccf8930ee6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.016207:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.016209:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.016211:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787862738.017191:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787862738.017200:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.017210:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787862738.017213:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862738.017218:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.017228:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.017393:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.017401:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.017421:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862738.018146:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862738.018155:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.018164:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862738.018169:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.018179:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.018198:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.018205:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037cc8e41/0x9c5536ccf8930eed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.018222:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862738.018224:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862738.018226:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787862738.018600:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787862738.018612:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.018622:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1787862738.018638:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862738.018644:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.018656:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.018666:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.018673:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.018690:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862738.019138:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862738.019144:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.019151:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862738.019161:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.019168:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.019179:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.019186:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a689222/0x9c5536ccf8930ef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.019200:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862738.019202:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862738.019203:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787862738.020613:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787862738.020624:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.020637:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1787862738.020641:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862738.020647:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.020658:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.020668:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.020682:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862738.020705:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787862738.021007:0:14998:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:2.0:1787862738.021146:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787862738.021153:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.021161:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:2.0:1787862738.021165:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.021174:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.021196:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.021204:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007de2bc73/0x9c5536ccf8930efb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862738.021221:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.021223:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862738.021225:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862738.021594:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14338:x1874709526451712:12345-0@lo:5:osp-pre-0-0.0 Request processed in 155289us (234848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862738.021605:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862738.021839:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14338:1874709526451712:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787862738.021854:0:14338:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787862738.021899:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14338:1874709526451840:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787862738.021935:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862738.022015:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fadd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862738.023702:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451840 00000100:00100000:0.0:1787862738.023716:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451840 00000100:00100000:0.0:1787862738.023878:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862738.023890:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14338:x1874709526451840:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787862738.023941:0:15000:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1787862738.053700:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14338:x1874709526451840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29803us (31754us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787862738.053726:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862738.054980:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14338:1874709526451840:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787862738.055007:0:14338:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787862738.268657:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862739.300954:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862739.820744:0:15368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787862740.327253:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787862740.359672:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787862740.359706:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787862741.340697:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862742.365658:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862743.199416:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862743.199424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787862743.199428:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862743.199447:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1787862743.199454:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787862743.199460:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862743.199485:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401a412c0 x1874709526452224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862743.199545:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526451968:0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.199626:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862743.199689:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862743.199695:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526452096:0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.199722:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862743.199755:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526452224:0@lo:8:kworker.0 00000100:00100000:1.0:1787862743.199780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862743.199811:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526452352:0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.199841:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862743.199861:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862743.199886:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526452480:0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.199914:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862743.199950:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526451968 00000100:00100000:1.0:1787862743.199958:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526451968 00000100:00100000:1.0:1787862743.200076:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787862743.200086:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3283:x1874709526451968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.200141:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3283:x1874709526451968:12345-0@lo:400:kworker.0 Request processed in 56us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862743.200148:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787862743.200198:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452096 00000100:00100000:1.0:1787862743.200202:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452096 00000100:00100000:1.0:1787862743.200236:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452224 00000100:00100000:1.0:1787862743.200239:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452224 00000100:00100000:1.0:1787862743.200251:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862743.200258:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526452096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.200289:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526452096:12345-0@lo:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862743.200295:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787862743.200307:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862743.200311:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526452224:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787862743.200327:0:14998:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787862743.204168:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452352 00000100:00100000:3.0:1787862743.204198:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452352 00000100:00100000:3.0:1787862743.204269:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452480 00000100:00100000:3.0:1787862743.204273:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452480 00000100:00100000:3.0:1787862743.204298:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862743.204308:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526452352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862743.204432:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526452352:12345-0@lo:400:kworker.0 Request processed in 125us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862743.204595:0:14314:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787862743.204606:0:14314:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787862743.204724:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862743.204733:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526452480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862743.204770:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526452480:12345-0@lo:400:kworker.0 Request processed in 40us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862743.204778:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787862743.205117:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787862743.205223:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862743.205228:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862743.205284:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787862743.205306:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526452096:0@lo:400:kworker.0 00000100:00100000:0.0:1787862743.205319:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526451968:0@lo:400:kworker.0 00000100:00100000:0.0:1787862743.211268:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526452608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862743.211372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862743.211466:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452608 00000100:00100000:0.0:1787862743.211474:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452608 00000100:00100000:0.0:1787862743.211522:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862743.211530:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526452608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862743.211571:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862743.211612:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526452608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862743.211619:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862743.211680:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526452608:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787862743.218701:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401a43840 x1874709526452480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862743.218727:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526452480:0@lo:400:kworker.0 00010000:00080000:0.0:1787862743.218744:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401a41680 x1874709526452352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862743.218752:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526452352:0@lo:400:kworker.0 00000100:00100000:1.0:1787862743.233917:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874709526452224:12345-0@lo:8:kworker.0 Request processed in 33592us (34124us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787862743.233936:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787862743.234346:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862743.234352:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787862743.234357:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526452224:0@lo:8:kworker.0 00010000:00010000:0.0:1787862743.388232:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862744.412523:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862744.805037:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787862745.436386:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862746.469285:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862747.485279:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862748.316790:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1787862748.317183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862748.317189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787862748.317201:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862748.317211:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1787862748.317217:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787862748.317227:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862748.317257:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401a43480 x1874709526453120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862748.327472:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526452864:0@lo:400:kworker.0 00000100:00100000:1.0:1787862748.327593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862748.327669:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862748.327678:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526452992:0@lo:400:kworker.0 00000100:00100000:1.0:1787862748.327709:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862748.327750:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526453120:0@lo:8:kworker.0 00000100:00100000:1.0:1787862748.327777:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862748.327811:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526453376:0@lo:400:kworker.0 00000100:00100000:1.0:1787862748.327841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862748.327883:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452864 00000100:00100000:1.0:1787862748.327893:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452864 00000100:00100000:1.0:1787862748.327967:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862748.327978:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3281:x1874709526452864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862748.328065:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3281:x1874709526452864:12345-0@lo:400:kworker.0 Request processed in 88us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862748.328073:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787862748.328279:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526453248:0@lo:400:kworker.0 00000100:00100000:2.0:1787862748.328315:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862748.328346:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526452736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862748.328372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862748.328405:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452736 00000100:00100000:2.0:1787862748.328409:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452736 00000100:00100000:2.0:1787862748.328462:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862748.328470:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526452736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862748.328515:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862748.328713:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526452992 00000100:00100000:1.0:1787862748.328718:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526452992 00000100:00100000:1.0:1787862748.328743:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453120 00000100:00100000:1.0:1787862748.328745:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453120 00000100:00100000:1.0:1787862748.328768:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862748.328774:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526452992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862748.329116:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453376 00000100:00100000:0.0:1787862748.329122:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453376 00000100:00100000:0.0:1787862748.329159:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453248 00000100:00100000:0.0:1787862748.329172:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453248 00000100:00100000:0.0:1787862748.329198:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862748.329207:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526453376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862748.336739:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526452992:12345-0@lo:400:kworker.0 Request processed in 7948us (9012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862748.336762:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787862748.336815:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862748.336824:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874709526453120:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787862748.336853:0:15001:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787862748.341529:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526453376:12345-0@lo:400:kworker.0 Request processed in 12303us (13665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862748.341555:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862748.341627:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862748.341645:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526453248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862748.341713:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526453248:12345-0@lo:400:kworker.0 Request processed in 77us (13398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862748.341738:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787862748.342449:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401a42580 x1874709526453376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862748.342471:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526453376:0@lo:400:kworker.0 00000100:00080000:3.0:1787862748.343577:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862748.343588:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862748.343662:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526452736:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787862748.343724:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401a41a40 x1874709526453248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862748.343736:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526453248:0@lo:400:kworker.0 00000100:00100000:0.0:1787862748.344525:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526452992:0@lo:400:kworker.0 00000100:00100000:0.0:1787862748.344542:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526452864:0@lo:400:kworker.0 00000100:00100000:2.0:1787862748.345824:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526452736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17346us (17441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862748.345841:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787862748.376206:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874709526453120:12345-0@lo:8:kworker.0 Request processed in 39368us (48414us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787862748.376228:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787862748.376506:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862748.376514:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787862748.376519:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526453120:0@lo:8:kworker.0 00010000:00010000:3.0:1787862748.521249:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862749.538485:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862750.558331:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862751.580435:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787862751.891088:0:15720:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787862751.891094:0:15720:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787862751.891229:0:15720:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a650741b800 00000020:01000004:2.0:1787862751.891251:0:15720:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787862751.891269:0:15720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787862751.891288:0:15720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6403274ed8) 00000020:00000080:2.0:1787862751.891312:0:15720:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787862751.932284:0:15720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787862751.933841:0:15720:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787862751.938764:0:15720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787862751.939583:0:15720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787862751.941150:0:15720:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787862751.941542:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 493: rc = 0 00100000:10000000:0.0:1787862751.944190:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 493: rc = 0 00100000:10000000:0.0:1787862751.944443:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 493: rc = 0 00100000:10000000:0.0:1787862751.944896:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:0.0:1787862751.945295:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:0.0:1787862751.945554:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:0.0:1787862751.945811:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:0.0:1787862751.946112:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:0.0:1787862751.946360:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00000020:00000080:0.0:1787862751.952882:0:15720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787862751.952902:0:15720:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787862751.952925:0:15720:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c5536ccf8930f09 00000020:01000004:0.0:1787862751.952934:0:15720:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787862751.952957:0:15720:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787862751.952961:0:15720:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787862751.952968:0:15720:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787862751.953000:0:15720:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787862751.953004:0:15720:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787862751.974298:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787862751.974524:0:15720:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.160@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787862751.974529:0:15720:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787862751.974531:0:15720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787862751.974532:0:15720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862751.974534:0:15720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862751.974535:0:15720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862751.974537:0:15720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862751.974538:0:15720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862751.974540:0:15720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862751.974542:0:15720:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787862751.974546:0:15720:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787862751.974548:0:15720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787862751.974550:0:15720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787862751.974551:0:15720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862751.974552:0:15720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862751.974553:0:15720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862751.974554:0:15720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862751.974555:0:15720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862751.974556:0:15720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862751.974557:0:15720:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787862751.974584:0:15720:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787862751.974726:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787862751.974813:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862751.974933:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862751.975232:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453504 00000100:00100000:0.0:1787862751.975241:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453504 00000100:00100000:0.0:1787862751.975475:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787862751.975493:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:15720:x1874709526453504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787862751.975527:0:14308:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787862751.975530:0:14308:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787862751.975534:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787862751.987299:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:15720:x1874709526453504:12345-0@lo:253:mount.lustre.0 Request processed in 11799us (12477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862751.987509:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787862751.987539:0:15720:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787862751.987542:0:15720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787862751.987543:0:15720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787862751.987544:0:15720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787862751.987546:0:15720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787862751.987547:0:15720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787862751.987548:0:15720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787862751.987549:0:15720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787862751.987551:0:15720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787862751.987552:0:15720:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787862751.987573:0:15720:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a650741b800 from lustre-OST0001 10000000:01000000:3.0:1787862751.987620:0:15720:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787862751.987624:0:15720:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787862751.987633:0:15720:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6533eeb490 local copy 00010000:00010000:3.0:1787862751.987643:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862751.987867:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862751.987909:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862751.987983:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787862751.988036:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058300 going to sleep for 11 seconds 00000100:00100000:2.0:1787862751.988530:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453632 00000100:00100000:2.0:1787862751.988539:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453632 00000100:00100000:2.0:1787862751.988584:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787862751.988602:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:15720:x1874709526453632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862751.988994:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:15720:x1874709526453632:12345-0@lo:501:mount.lustre.0 Request processed in 400us (1083us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862751.989002:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787862751.989213:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453632:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787862751.989231:0:15720:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787862751.989543:0:15720:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787862751.989552:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862751.989563:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534636400/0x9c5536ccf8930cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930cbd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862751.989586:0:15720:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a650741b800 10000000:01000000:3.0:1787862751.989609:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787862751.989733:0:15720:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787862751.989737:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787862751.989742:0:15720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787862751.989745:0:15720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787862751.989772:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862751.989781:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862751.989791:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862751.989808:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787862751.989847:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862751.989883:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058300 going to sleep for 11 seconds 00000100:00100000:2.0:1787862751.989993:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453760 00000100:00100000:2.0:1787862751.990004:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453760 00000100:00100000:2.0:1787862751.990086:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787862751.990094:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:15720:x1874709526453760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862751.990106:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862751.990118:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919a00/0x9c5536ccf8930f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930f10 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862751.990140:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919a00/0x9c5536ccf8930f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930f10 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862751.990152:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919a00/0x9c5536ccf8930f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930f10 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862751.990161:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919a00, rc 0) 00000100:00100000:2.0:1787862751.990191:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526453760:12345-0@lo:101:mount.lustre.0 Request processed in 98us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862751.990197:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787862751.990349:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862751.992791:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862751.992806:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862751.995005:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787862751.997786:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862751.998518:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787862751.998578:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787862752.000904:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787862752.001028:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787862752.001575:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787862752.002338:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787862752.002543:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787862752.002552:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787862752.002895:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862752.002982:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.003031:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.003460:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526453888 00000100:00100000:2.0:1787862752.003468:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526453888 00000100:00100000:2.0:1787862752.003580:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787862752.003590:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526453888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862752.004145:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526453888:12345-0@lo:501:mount.lustre.0 Request processed in 556us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.004154:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787862752.004308:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526453888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862752.005173:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862752.005244:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.014182:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058240 going to sleep for 11 seconds 00000100:00100000:1.0:1787862752.015452:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454016 00000100:00100000:1.0:1787862752.015470:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454016 00000100:00100000:1.0:1787862752.015554:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787862752.015564:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787862752.016995:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454016:12345-0@lo:503:mount.lustre.0 Request processed in 1425us (11743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862752.017010:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787862752.017428:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787862752.021125:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862752.021216:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862752.021300:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.023511:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058240 going to sleep for 11 seconds 00000100:00100000:0.0:1787862752.023787:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454144 00000100:00100000:0.0:1787862752.023797:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454144 00000100:00100000:1.0:1787862752.023898:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787862752.023935:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862752.024288:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454144:12345-0@lo:502:mount.lustre.0 Request processed in 355us (2986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862752.024296:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787862752.025082:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862752.025498:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787862752.025564:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787862752.025725:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787862752.025785:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787862752.025824:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787862752.025856:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787862752.025895:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787862752.025942:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787862752.025992:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787862752.026038:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862752.026445:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.026526:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058240 going to sleep for 11 seconds 00000100:00100000:1.0:1787862752.026626:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454272 00000100:00100000:1.0:1787862752.026633:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454272 00000100:00100000:1.0:1787862752.026669:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787862752.026679:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787862752.026895:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454272:12345-0@lo:502:mount.lustre.0 Request processed in 217us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862752.026903:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787862752.027084:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862752.027169:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787862752.027182:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787862752.028729:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787862752.028740:0:15721:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787862752.028748:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787862752.028750:0:15721:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787862752.028755:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787862752.028771:0:15721:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a6403288000) 00000020:00000080:3.0:1787862752.028793:0:15721:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787862752.028799:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787862752.028883:0:15721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650741b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787862752.028890:0:15721:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787862752.028897:0:15721:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c5536ccf8930f25 00010000:00010000:3.0:1787862752.040488:0:15721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787862752.042212:0:15721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787862752.049124:0:15721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1787862752.054170:0:15721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787862752.054183:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862752.054190:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.054192:0:15721:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787862752.054196:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862752.054200:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.054201:0:15721:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787862752.054204:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787862752.054206:0:15721:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787862752.054208:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862752.054210:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.054211:0:15721:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787862752.054213:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862752.054216:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.054217:0:15721:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787862752.054220:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787862752.054255:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862752.054258:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.054260:0:15721:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787862752.054276:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787862752.055242:0:15720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787862752.055274:0:15720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787862752.055298:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.055322:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a653422d600/0x9c5536ccf8930f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f17 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862752.055331:0:15720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650741b800 from 1 10000000:01000000:3.0:1787862752.055334:0:15720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862752.055373:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.055395:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.055406:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862752.055442:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787862752.055513:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.055555:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:0.0:1787862752.055796:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454400 00000100:00100000:0.0:1787862752.055803:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454400 00000100:00100000:0.0:1787862752.055848:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787862752.055857:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:15720:x1874709526454400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787862752.055870:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862752.055884:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930f2c expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862752.055907:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862752.055929:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862752.055939:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636a00, rc 0) 00000100:00100000:0.0:1787862752.055979:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454400:12345-0@lo:101:mount.lustre.0 Request processed in 122us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.055987:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787862752.056347:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862752.056363:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.056373:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862752.057025:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787862752.058587:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862752.062690:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787862752.065060:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787862752.065246:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787862752.065256:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787862752.065352:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862752.065419:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.065456:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.069284:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454528 00000100:00100000:2.0:1787862752.069302:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454528 00000100:00100000:2.0:1787862752.069725:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787862752.069735:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862752.071435:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454528:12345-0@lo:501:mount.lustre.0 Request processed in 1697us (6010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.071449:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787862752.076754:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862752.076976:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862752.077114:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862752.077155:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862752.077223:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454656 00000100:00100000:0.0:1787862752.077230:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454656 00000100:00100000:0.0:1787862752.077287:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862752.077296:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787862752.077715:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454656:12345-0@lo:503:mount.lustre.0 Request processed in 418us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.077732:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787862752.077867:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787862752.078864:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787862752.078961:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862752.079028:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.079090:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.079178:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454784 00000100:00100000:2.0:1787862752.079184:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454784 00000100:00100000:2.0:1787862752.079226:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787862752.079236:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862752.079531:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454784:12345-0@lo:502:mount.lustre.0 Request processed in 295us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.079539:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862752.079830:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787862752.080740:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787862752.080809:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787862752.080877:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787862752.080930:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787862752.080970:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787862752.081020:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787862752.082267:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787862752.082447:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787862752.082503:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862752.082586:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862752.082733:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787862752.082776:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526454912 00000100:00100000:0.0:1787862752.082829:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526454912 00000100:00100000:0.0:1787862752.082926:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862752.082937:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787862752.083236:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526454912:12345-0@lo:502:mount.lustre.0 Request processed in 301us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.083243:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862752.083359:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526454912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787862752.083475:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787862752.083487:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787862752.084638:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862752.084650:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.084652:0:15725:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787862752.084659:0:15725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a650741b800 00000020:00000080:1.0:1787862752.084662:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787862752.084669:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862752.084672:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.084674:0:15725:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787862752.084676:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862752.084679:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.084680:0:15725:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787862752.084682:0:15725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a650741b800 00000020:00000080:1.0:1787862752.084684:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787862752.084744:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862752.084748:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.084749:0:15725:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787862752.084752:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787862752.084755:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.084756:0:15725:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787862752.084759:0:15725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a650741b800 00000020:00000080:1.0:1787862752.084761:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787862752.084792:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787862752.084796:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787862752.084797:0:15725:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787862752.084799:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787862752.085069:0:15720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787862752.085094:0:15720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862752.085111:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.085124:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862752.085170:0:15720:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787862752.085173:0:15720:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a650741b800 10000000:01000000:3.0:1787862752.085176:0:15720:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a650741b800 10000000:01000000:3.0:1787862752.085180:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787862752.085185:0:15720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a650741b800 from 1 10000000:01000000:3.0:1787862752.085187:0:15720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787862752.085223:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.085230:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.085252:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862752.085274:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787862752.085351:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.089062:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.089206:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455040 00000100:00100000:2.0:1787862752.089216:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455040 00000100:00100000:2.0:1787862752.089270:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862752.089279:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526455040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787862752.089296:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862752.089443:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918000/0x9c5536ccf8930f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930f3a expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862752.089478:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918000/0x9c5536ccf8930f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930f3a expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862752.089506:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918000/0x9c5536ccf8930f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930f3a expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862752.089515:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918000, rc 0) 00000100:00100000:2.0:1787862752.089590:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455040:12345-0@lo:101:mount.lustre.0 Request processed in 311us (4238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862752.089703:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787862752.089721:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.089730:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862752.090404:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000040:00080000:3.0:1787862752.090775:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787862752.092949:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862752.094219:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787862752.094296:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787862752.094705:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787862752.094759:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787862752.094797:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787862752.094863:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787862752.094900:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787862752.094954:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787862752.095006:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787862752.097223:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787862752.097333:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787862752.097407:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787862752.097445:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787862752.097479:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787862752.097545:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787862752.097583:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787862752.100925:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787862752.101070:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787862752.101113:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787862752.101149:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787862752.101198:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787862752.101265:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787862752.101293:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787862752.101351:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787862752.101386:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787862752.101421:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787862752.101483:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787862752.101524:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787862752.101559:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787862752.102784:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787862752.102862:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787862752.102898:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787862752.102945:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787862752.103001:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787862752.103038:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787862752.103104:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787862752.103139:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787862752.103255:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787862752.103263:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787862752.103369:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862752.103444:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.103482:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.103571:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455168 00000100:00100000:2.0:1787862752.103579:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455168 00000100:00100000:2.0:1787862752.103647:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862752.103657:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787862752.103874:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455168:12345-0@lo:501:mount.lustre.0 Request processed in 218us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.103883:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787862752.108862:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787862752.108940:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787862752.109058:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.109102:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505509600 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.114415:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455296 00000100:00100000:2.0:1787862752.114434:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455296 00000100:00100000:2.0:1787862752.114500:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787862752.114512:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787862752.114974:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455296:12345-0@lo:503:mount.lustre.0 Request processed in 462us (5931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.114983:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787862752.115108:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787862752.115992:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787862752.116097:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862752.116154:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862752.116201:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517e40780 going to sleep for 11 seconds 00000100:00100000:3.0:1787862752.116492:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455424 00000100:00100000:3.0:1787862752.116500:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455424 00000100:00100000:3.0:1787862752.116546:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787862752.116555:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787862752.116886:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455424:12345-0@lo:502:mount.lustre.0 Request processed in 332us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862752.116894:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862752.123695:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787862752.124037:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787862752.124119:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787862752.124153:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787862752.124200:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787862752.124236:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787862752.124286:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787862752.124336:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787862752.124370:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787862752.124418:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787862752.124456:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787862752.124493:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787862752.124539:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787862752.124572:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787862752.124604:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787862752.124651:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787862752.124687:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787862752.124721:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787862752.124771:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787862752.124808:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787862752.124840:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787862752.124887:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787862752.129241:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787862752.129336:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787862752.129418:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787862752.129457:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787862752.129494:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787862752.129543:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787862752.129580:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787862752.130758:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787862752.130829:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787862752.130878:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787862752.130946:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787862752.130984:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787862752.131034:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787862752.131098:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787862752.131148:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787862752.131185:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787862752.131218:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787862752.131269:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787862752.131307:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787862752.131360:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862752.131439:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862752.131490:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517e40780 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.131522:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455552 00000100:00100000:2.0:1787862752.131529:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455552 00000100:00100000:2.0:1787862752.131581:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787862752.131591:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787862752.134294:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526455552:12345-0@lo:502:mount.lustre.0 Request processed in 2699us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.134305:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862752.139138:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526455552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787862752.139307:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787862752.139325:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787862752.140802:0:15730:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787862752.140818:0:15730:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a640328ced8) 00000020:00000080:3.0:1787862752.140839:0:15730:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787862752.140930:0:15730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a650741b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787862752.140935:0:15730:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a650741b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787862752.140938:0:15730:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a650741b800 3 00010000:00080000:3.0:1787862752.140969:0:15730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6401bc1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.160@tcp at head 00010000:00010000:3.0:1787862752.146295:0:15730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787862752.146516:0:15730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787862752.146559:0:15730:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787862752.146573:0:15730:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c5536ccf8930f4f 00000100:00080000:3.0:1787862752.146584:0:15730:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787862752.146590:0:15730:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6401bc1800 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:3.0:1787862752.146628:0:15730:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a64031dc780 x1874709526455680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787862752.146653:0:15730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787862752.150545:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526455680:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787862752.150624:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787862752.150728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862752.150740:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787862752.150743:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862752.150748:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1787862752.150752:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787862752.150758:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862752.150781:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401a42940 x1874709526455936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787862752.150828:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526455936:0@lo:8:kworker.0 00000100:00100000:1.0:1787862752.150858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862752.151195:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455680 00000100:00100000:0.0:1787862752.151202:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455680 00000100:00100000:0.0:1787862752.151246:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862752.151254:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874709526455680:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787862752.151280:0:15473:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1787862752.151321:0:15473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c5536ccf8930f56 00000004:00100000:0.0:1787862752.151338:0:15473:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787862752.151373:0:15473:0:(import.c:65:import_set_state_nolock()) ffff9a652731f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862752.151432:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874709526455680:12345-0@lo:38:llog_process_th.0 Request processed in 177us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.151440:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862752.151467:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526455808:0@lo:400:kworker.0 00000100:00100000:0.0:1787862752.151494:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862752.151523:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862752.151540:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526456064:0@lo:400:kworker.0 00000100:00100000:0.0:1787862752.151566:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862752.151591:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455936 00000100:00100000:0.0:1787862752.151595:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455936 00000100:00100000:0.0:1787862752.151614:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526455808 00000100:00100000:0.0:1787862752.151617:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526455808 00000100:00100000:0.0:1787862752.151651:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862752.151659:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526455808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862752.151698:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526455808:12345-0@lo:400:kworker.0 Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.151704:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862752.151714:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862752.151718:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3280:x1874709526455936:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787862752.151750:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3280:x1874709526455936:12345-0@lo:8:kworker.0 Request processed in 30us (891us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787862752.151758:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787862752.151788:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862752.151795:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787862752.151798:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787862752.151802:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526455936:0@lo:8:kworker.0 00010000:00080000:0.0:1787862752.151819:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a64031dc780 x1874709526455680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787862762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862752.151827:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787862752.151832:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787862752.151839:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787862752.151844:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787862752.151846:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787862752.151857:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874709526455680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787862752.151889:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456064 00000100:00100000:0.0:1787862752.151892:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456064 00000100:00100000:0.0:1787862752.151928:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862752.151934:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526456064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862752.151969:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526456064:12345-0@lo:400:kworker.0 Request processed in 35us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.151976:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787862752.152008:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401a43480 x1874709526456064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862752.152019:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526456064:0@lo:400:kworker.0 00000100:00100000:0.0:1787862752.152029:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526455808:0@lo:400:kworker.0 00000100:00100000:3.0:1787862752.152222:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526456192:0@lo:400:kworker.0 00000100:00100000:3.0:1787862752.152258:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787862752.152307:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787862752.152481:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1787862752.153675:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456192 00000100:00100000:0.0:1787862752.153685:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456192 00000100:00100000:0.0:1787862752.153784:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787862752.153793:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526456192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862752.153860:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526456192:12345-0@lo:400:kworker.0 Request processed in 69us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862752.153868:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787862752.155652:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787862752.155705:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6401a421c0 x1874709526456192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787862752.155722:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526456192:0@lo:400:kworker.0 00000020:01000000:0.0:1787862752.155873:0:15720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787862752.155910:0:15720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787862752.155943:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862752.155956:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a653422c600/0x9c5536ccf8930f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f41 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787862752.156019:0:15720:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787862752.156021:0:15720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862752.156023:0:15720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862752.156024:0:15720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862752.156025:0:15720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862752.156027:0:15720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862752.156028:0:15720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862752.156030:0:15720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862752.156032:0:15720:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787862752.156036:0:15720:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787862752.156038:0:15720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787862752.156853:0:15720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862752.156855:0:15720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862752.156856:0:15720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862752.156857:0:15720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862752.156859:0:15720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862752.156860:0:15720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862752.156861:0:15720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862752.156863:0:15720:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787862752.156908:0:15720:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787862752.156938:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526456320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787862752.157011:0:15720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862752.157118:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65064bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862752.161741:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456320 00000100:00100000:1.0:1787862752.161756:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456320 00000100:00100000:2.0:1787862752.161900:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862752.161921:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:15720:x1874709526456320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787862752.161962:0:14308:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787862752.161979:0:14308:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787862752.205561:0:14308:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787862752.205580:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787862752.205982:0:14330:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787862752.205988:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787862752.206014:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.206033:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.206144:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.206186:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.206201:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 19 pid: 14309 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862752.206215:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874709526456448:0@lo:104: 00000100:00100000:3.0:1787862752.206282:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.206332:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651fc429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862752.206406:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456448 00000100:00100000:2.0:1787862752.206427:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456448 00000100:00100000:2.0:1787862752.206478:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862752.206487:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14330:x1874709526456448:12345-0@lo:104: 00010000:00010000:2.0:1787862752.206500:0:14298:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862752.206574:0:14298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787862752.206581:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:14330:x1874709526456448:12345-0@lo:104: Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862752.206589:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862752.207183:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874709526456448:0@lo:104: 00010000:00010000:3.0:1787862752.207209:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.207241:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862752.207247:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.207256:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422de00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:3.0:1787862752.207260:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.207268:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787862752.207275:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862752.207282:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787862752.207321:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.207328:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787862752.207348:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.207356:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a653422de00/0x9c5536ccf8930e30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930e37 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.207373:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862752.207375:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862752.207377:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862752.207391:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526456576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862752.210338:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862752.210423:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456576 00000100:00100000:3.0:1787862752.210432:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456576 00010000:00010000:3.0:1787862752.210469:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 20 pid: 14309 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862752.210500:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787862752.210510:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+20:3284:x1874709526456576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787862752.210524:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862752.210530:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 20 pid: 14309 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210543:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 20 pid: 14309 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210568:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534636000/0x9c5536ccf8930e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930e30 expref: 20 pid: 14309 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210585:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210593:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787862752.210608:0:14299:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004621439s 00010000:00010000:3.0:1787862752.210613:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210620:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210643:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210650:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210657:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422cc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862752.210661:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210669:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210685:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210695:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862752.210730:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526456576:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862752.210736:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787862752.210765:0:14330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210771:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862752.210777:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8930f5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862752.210810:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526456576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862752.238214:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:15720:x1874709526456320:12345-0@lo:253:mount.lustre.0 Request processed in 76291us (81189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862752.238230:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787862752.238391:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:15720:1874709526456320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787862752.238476:0:15720:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787862752.238481:0:15720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787862752.238483:0:15720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787862752.238484:0:15720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787862752.238486:0:15720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787862752.238487:0:15720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787862752.238488:0:15720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787862752.238490:0:15720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787862752.238492:0:15720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787862752.238493:0:15720:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787862752.238514:0:15720:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787862752.244947:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862752.245606:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862752.245860:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862752.246038:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787862752.246489:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787862752.246778:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787862752.247736:0:15720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787862752.309303:0:15720:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787862752.309315:0:15720:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787862752.309353:0:15720:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787862752.309502:0:15720:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787862752.309520:0:15720:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787862752.309558:0:15720:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787862752.609263:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862753.447442:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526456704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862753.447540:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862753.447623:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456704 00000100:00100000:2.0:1787862753.447633:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456704 00000100:00100000:2.0:1787862753.447686:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862753.447697:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526456704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862753.447738:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862753.447781:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526456704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862753.447788:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862753.447840:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526456704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862753.628777:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862754.077035:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787862754.210619:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787862754.210630:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a650ac37800 from 8 10000000:01000000:1.0:1787862754.210635:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787862754.210686:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862754.210699:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862754.210712:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862754.210740:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526456832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787862754.210833:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862754.210903:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6502fd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862754.210965:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456832 00000100:00100000:2.0:1787862754.210973:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456832 00000100:00100000:2.0:1787862754.211029:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787862754.211070:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526456832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862754.211091:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862754.211106:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919200/0x9c5536ccf8930f6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf8930f64 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862754.211132:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919200/0x9c5536ccf8930f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf8930f64 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862754.211143:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919200/0x9c5536ccf8930f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930f64 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862754.211152:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919200, rc 0) 00000100:00100000:2.0:1787862754.211204:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526456832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862754.211211:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787862754.211291:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526456832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862754.211318:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862754.211328:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862754.211381:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526456960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787862754.211416:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862754.211454:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862754.211728:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526456960 00000100:00100000:1.0:1787862754.211734:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526456960 00000100:00100000:1.0:1787862754.211767:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862754.211775:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526456960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787862754.211790:0:14308:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787862754.211807:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787862754.211810:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787862754.211920:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526456960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862754.211927:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787862754.212521:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526456960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787862754.212618:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787862754.212628:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862754.212638:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6401b78200/0x9c5536ccf8930f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf8930f6b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862754.653944:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862755.676283:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862756.700550:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787862757.532317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787862757.532326:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787862757.532330:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787862757.532343:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a653daec000 using connection 192.168.202.160@tcp/0@lo 00000100:00100000:1.0:1787862757.532367:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6401a43480 x1874709526457344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787862757.532490:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526457600:0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.532568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862757.532646:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862757.532653:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526457088:0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.532684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862757.532710:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a650a17ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526457728:0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.532733:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862757.532759:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526457344:0@lo:8:kworker.0 00000100:00100000:0.0:1787862757.532785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862757.532818:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457088 00000100:00100000:0.0:1787862757.532825:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457088 00000100:00100000:0.0:1787862757.532877:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862757.532886:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526457088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.532935:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526457088:12345-0@lo:400:kworker.0 Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862757.532943:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787862757.532987:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457600 00000100:00100000:0.0:1787862757.532990:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457600 00000100:00100000:0.0:1787862757.533030:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457728 00000100:00100000:0.0:1787862757.533034:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457728 00000100:00100000:0.0:1787862757.533090:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862757.533096:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526457600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.533147:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526457600:12345-0@lo:400:kworker.0 Request processed in 51us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862757.533154:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862757.533166:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862757.533172:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526457728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.533198:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526457728:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862757.533204:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787862757.533221:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457344 00000100:00100000:0.0:1787862757.533225:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457344 00000100:00100000:0.0:1787862757.533243:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787862757.533249:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3280:x1874709526457344:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787862757.533272:0:15000:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1787862757.533300:0:15000:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c5536ccf8930f72 00002000:00100000:0.0:1787862757.533313:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a6527319800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787862757.533318:0:15000:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787862757.533321:0:15000:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787862757.533680:0:15000:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787862757.533705:0:15000:0:(import.c:65:import_set_state_nolock()) ffff9a652731b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862757.533745:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1874709526457344:12345-0@lo:8:kworker.0 Request processed in 495us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862757.533753:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787862757.533771:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787862757.533807:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401a43480 x1874709526457344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787862782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787862757.533822:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787862757.533839:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787862757.533845:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787862757.533848:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9a653daec000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787862757.533859:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787862757.533876:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874709526457344:0@lo:8:kworker.0 00000100:00100000:0.0:1787862757.533908:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526457088:0@lo:400:kworker.0 00010000:00080000:0.0:1787862757.533918:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a650a17ed00 x1874709526457728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862757.533927:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a650a17ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526457728:0@lo:400:kworker.0 00010000:00080000:0.0:1787862757.533938:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401a42580 x1874709526457600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862757.533947:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526457600:0@lo:400:kworker.0 00000004:00080000:1.0:1787862757.534172:0:14340:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787862757.534190:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14340:1874709526457984:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787862757.534221:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862757.534252:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102d1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787862757.534636:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526457216:0@lo:400:kworker.0 00000100:00100000:3.0:1787862757.534693:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862757.534714:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a650a17ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526457856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862757.534736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862757.534758:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862757.534764:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526457472:0@lo:400:kworker.0 00000100:00100000:3.0:1787862757.534786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787862757.534817:0:14339:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787862757.535197:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457856 00000100:00100000:1.0:1787862757.535204:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457856 00000100:00100000:1.0:1787862757.535251:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862757.535267:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526457856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862757.535295:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862757.535344:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526457856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862757.535351:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787862757.535374:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787862757.535396:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a650a17ed00 x1874709526457856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787862773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862757.535412:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a650a17ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526457856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862757.535433:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457984 00000100:00100000:1.0:1787862757.535436:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457984 00000100:00100000:1.0:1787862757.535460:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457216 00000100:00100000:1.0:1787862757.535463:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457216 00000100:00100000:1.0:1787862757.535484:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862757.535490:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526457216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862757.535526:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526457216:12345-0@lo:400:kworker.0 Request processed in 36us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862757.535533:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787862757.535544:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862757.535550:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14340:x1874709526457984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787862757.538068:0:15000:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787862757.538081:0:15000:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787862757.538087:0:15000:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:3.0:1787862757.541708:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526457472 00000100:00100000:3.0:1787862757.541720:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526457472 00000100:00100000:3.0:1787862757.541782:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787862757.541793:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526457472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862757.541898:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526457472:12345-0@lo:400:kworker.0 Request processed in 107us (7110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862757.541914:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787862757.542287:0:14339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 483306242279ns, next at 0ns, rc = 0 00000100:00080000:0.0:1787862757.553443:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787862757.553518:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6401a42940 x1874709526457472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787862757.553537:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526457472:0@lo:400:kworker.0 00000100:00100000:0.0:1787862757.553553:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526457216:0@lo:400:kworker.0 00002000:00010000:1.0:1787862757.564763:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.564778:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564815:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.564821:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.564831:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564857:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564888:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564897:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564934:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.564953:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.564959:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564967:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.564972:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.564982:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565014:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565022:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565087:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.565089:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.565091:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.565819:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.565827:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565837:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.565841:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.565845:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565854:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565875:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565883:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565911:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.565922:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.565927:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565934:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.565937:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565945:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565957:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565964:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c10a4b2/0x9c5536ccf8930f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.565978:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.565980:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.565981:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.566414:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.566422:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566431:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.566441:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.566445:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566455:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566463:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566470:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566485:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.566494:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.566499:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566505:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.566508:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566516:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566526:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566543:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3549966/0x9c5536ccf8930f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.566555:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.566556:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.566558:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.577446:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.577461:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.577479:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.577484:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.577491:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.577503:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.577513:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.577520:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.577691:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787862757.582846:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.582880:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.582899:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.582904:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.582911:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.582926:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.582936:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.582952:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586191:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787862757.586208:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586223:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79a00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.586230:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586252:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586281:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586289:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b37dff70/0x9c5536ccf8930f8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586309:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862757.586313:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586319:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.586321:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586328:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586337:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.586344:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.586345:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.586353:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.586488:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787862757.586497:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8cf08cd/0x9c5536ccf8930f95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.587217:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.588486:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.588498:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588516:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.588521:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.588535:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588549:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588559:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588566:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588589:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.588604:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.588611:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588618:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.588623:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588632:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588649:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588668:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb4008f/0x9c5536ccf8930f9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.588686:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.588688:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.588689:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.589191:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.589199:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589209:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.589212:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.589216:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589226:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589234:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589241:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589254:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787862757.589635:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.589646:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589655:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.589659:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.589663:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589673:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589682:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589689:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589706:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787862757.589718:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862757.589722:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589729:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.589732:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589740:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589761:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589769:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e4754f/0x9c5536ccf8930fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589785:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.589789:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589795:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.589798:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589804:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589813:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589819:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3b549a6/0x9c5536ccf8930faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.589830:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.589832:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.589838:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.590279:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.590285:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590294:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.590297:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.590302:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590311:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590319:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590325:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590339:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.590346:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.590350:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590357:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b79200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.590360:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590380:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590390:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590396:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846c958f/0x9c5536ccf8930fb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590407:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.590409:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.590410:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.590826:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.590834:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590842:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.590845:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.590850:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.590859:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.592634:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.601133:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.601161:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.601215:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862757.601329:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862757.601346:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.601372:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6401b78400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.601379:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.601393:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.601433:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.601442:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171d7d2c/0x9c5536ccf8930fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.601486:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.601491:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.601497:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.601961:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.601969:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.601984:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.601989:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.601995:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602010:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602020:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602028:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602101:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787862757.602484:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.602491:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602505:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.602509:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.602513:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602521:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602528:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602534:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.602555:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787862757.602674:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862757.602687:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602699:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.602718:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602729:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602752:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602761:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008979d094/0x9c5536ccf8930fbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602787:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862757.602791:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602799:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfda00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.602802:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602809:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602821:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602829:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ace30b9/0x9c5536ccf8930fc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.602856:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.602859:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.602869:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.603096:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.603104:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603114:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.603118:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.603122:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603131:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603151:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603158:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603175:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787862757.603579:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.603587:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603597:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.603600:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862757.603607:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.603608:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603618:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603626:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603635:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfdc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.603644:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603651:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603660:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603664:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603690:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603735:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eb7bbf6/0x9c5536ccf8930fcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.603740:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862757.603777:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862757.603782:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603791:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.603807:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603817:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603831:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603839:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032735ff1/0x9c5536ccf8930fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.603872:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.603874:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.603876:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.604282:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787862757.627316:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1787862757.627967:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.627986:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628005:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.628010:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.628018:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628034:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628105:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628113:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628138:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862757.628231:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862757.628248:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.628264:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.628270:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.628283:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.628314:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.628341:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf8930fdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.628395:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.628400:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.628408:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.628614:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.628622:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628642:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.628645:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.628650:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628660:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628671:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628679:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.628702:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787862757.629152:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.629160:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629169:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.629172:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.629176:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629186:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629206:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629212:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629234:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787862757.629568:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787862757.629580:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629594:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.629599:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629610:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629633:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629644:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aee1cfe/0x9c5536ccf8930fe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862757.629658:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.629667:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629673:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.629678:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787862757.629681:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629684:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.629689:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629699:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629730:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfde00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.629734:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629737:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629777:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629778:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629828:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629875:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfc7a7e/0x9c5536ccf8930fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.629885:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862757.629898:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862757.629904:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629913:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.629919:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629928:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629941:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629958:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c817270/0x9c5536ccf8930ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.629986:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.629989:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.629994:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.630393:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.630402:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.630412:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.630416:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.630421:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.630432:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.630440:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.630448:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.630471:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787862757.630518:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862757.630527:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.630536:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862757.630541:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.630550:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.630576:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.630587:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579e121f/0x9c5536ccf8930ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862757.630612:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.630614:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862757.630620:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.631106:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.640459:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.640482:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640509:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.640528:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.640535:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640552:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640563:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640571:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640602:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.640617:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.640623:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640629:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.640633:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640640:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640654:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640668:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000555626e0/0x9c5536ccf8930ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.640686:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.640687:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.640689:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.646491:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.646506:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.646527:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.646532:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.646540:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.646554:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.646566:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.646574:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.646609:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862757.647994:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862757.648019:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.648036:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.648058:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.648073:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.648103:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.648116:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f42f658/0x9c5536ccf8931005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.648154:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.648156:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.648158:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.649670:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.649693:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649712:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.649717:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.649723:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649734:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649741:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649746:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649767:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.649785:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.649789:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649794:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.649798:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649804:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649821:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649826:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b3e7a3/0x9c5536ccf893100c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.649842:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.649843:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.649844:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.651383:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.651393:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.651404:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.651407:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.651411:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.651424:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.651434:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.651443:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.651477:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862757.651991:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862757.652006:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.652037:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.652081:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.652094:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.652124:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.652134:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000139df21b/0x9c5536ccf8931013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.652165:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.652167:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.652169:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787862757.653073:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787862757.653302:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.653324:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.653343:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.653347:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.653352:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.653365:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.653373:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.653379:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.653410:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862757.653791:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862757.653803:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.653818:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.653823:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.653835:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.653883:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.653892:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeb29e8b/0x9c5536ccf893101a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.653922:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.653924:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.653926:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.654015:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.654022:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.654030:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.654037:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.654040:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.654072:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.654079:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.654084:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.654096:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862757.654136:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862757.654144:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.654154:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.654158:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.654167:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.654180:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.654187:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e3a4b29/0x9c5536ccf8931021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.654220:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.654223:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.654225:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787862757.658833:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787862757.658848:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.664823:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787862757.664840:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862757.664852:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.664886:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.664901:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.664937:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.665011:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862757.665185:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787862757.665202:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.665217:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862757.665223:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.665235:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.665262:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.665271:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b7f2e29/0x9c5536ccf8931028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.665653:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.665658:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862757.665662:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862757.667533:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862757.667551:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.667599:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787862757.667606:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862757.667615:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.667636:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.667649:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.667658:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.667682:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862757.668399:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.668418:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.668434:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.668439:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.668452:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.668480:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.668490:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd44791d/0x9c5536ccf893102f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.668533:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.668537:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.668542:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787862757.668639:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787862757.668649:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.668662:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787862757.668666:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787862757.668672:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.668684:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.668708:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.668717:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862757.668745:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787862757.668963:0:15000:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787862757.669135:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14340:x1874709526457984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 133578us (134906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862757.669150:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862757.670297:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14340:1874709526457984:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787862757.670352:0:14340:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787862757.670415:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14340:1874709526458112:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787862757.670487:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862757.670551:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6533e08540 going to sleep for 11 seconds 00010000:00010000:1.0:1787862757.670571:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862757.670581:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.670595:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862757.670600:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.670611:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.670632:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.670640:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099012e84/0x9c5536ccf8931036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862757.670664:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.670666:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862757.670668:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862757.671464:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458112 00000100:00100000:0.0:1787862757.671482:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458112 00000100:00100000:0.0:1787862757.672126:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862757.672147:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14340:x1874709526458112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787862757.672243:0:14998:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787862757.687385:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14340:x1874709526458112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15233us (16887us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787862757.687413:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787862757.687507:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14340:1874709526458112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787862757.687549:0:14340:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1787862757.725294:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862758.571039:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862758.571084:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526458240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862758.571180:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862758.571268:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458240 00000100:00100000:0.0:1787862758.571277:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458240 00000100:00100000:0.0:1787862758.571330:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862758.571341:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526458240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862758.571395:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862758.571443:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526458240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862758.571451:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787862758.571505:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526458240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862758.753102:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862759.772331:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787862760.581856:0:16076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg260-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787862760.798585:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862761.820564:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862762.653302:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526458368:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653382:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.653433:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526458880:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.653489:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787862762.653495:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526458496:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653519:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.653535:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526459008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653556:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.653582:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526458624:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653603:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.653621:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862762.653626:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526458752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.653683:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458368 00000100:00100000:1.0:1787862762.653691:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458368 00000100:00100000:1.0:1787862762.653737:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862762.653747:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526458368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653801:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526458368:12345-0@lo:400:kworker.0 Request processed in 54us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.653832:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862762.653874:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458880 00000100:00100000:1.0:1787862762.653878:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458880 00000100:00100000:1.0:1787862762.653909:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459008 00000100:00100000:1.0:1787862762.653913:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459008 00000100:00100000:1.0:1787862762.653925:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458752 00000100:00100000:1.0:1787862762.653927:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458752 00000100:00100000:1.0:1787862762.653938:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862762.653944:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.653977:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526458880:12345-0@lo:400:kworker.0 Request processed in 33us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.653984:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787862762.653995:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862762.654001:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526459008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654029:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526459008:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.654035:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862762.654068:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862762.654075:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654107:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526458752:12345-0@lo:400:kworker.0 Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.654113:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862762.654134:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458496 00000100:00100000:1.0:1787862762.654137:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458496 00000100:00100000:1.0:1787862762.654163:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526458624 00000100:00100000:1.0:1787862762.654166:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526458624 00000100:00100000:1.0:1787862762.654178:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862762.654191:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526458496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654221:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526458496:12345-0@lo:400:kworker.0 Request processed in 31us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.654227:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862762.654238:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862762.654244:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654269:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526458624:12345-0@lo:400:kworker.0 Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.654276:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787862762.654323:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e61c0 x1874709526458752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862762.654340:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526458752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654352:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526458624:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654383:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526458496:0@lo:400:kworker.0 00010000:00080000:1.0:1787862762.654393:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e70c0 x1874709526459008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862762.654401:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526459008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862762.654409:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526458368:0@lo:400:kworker.0 00010000:00080000:1.0:1787862762.654418:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a65346e5a40 x1874709526458880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787862778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787862762.654427:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526458880:0@lo:400:kworker.0 00000100:00080000:0.0:1787862762.654638:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862762.654643:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862762.654646:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862762.654805:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862762.654832:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526459136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862762.654870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862762.654904:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459136 00000100:00100000:1.0:1787862762.654909:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459136 00000100:00100000:1.0:1787862762.654936:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862762.654943:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874709526459136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862762.654973:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862762.655010:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874709526459136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862762.655016:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862762.655071:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526459136:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862762.844595:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787862762.845487:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1787862763.494766:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.494860:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517018880 00000100:00100000:1.0:1787862763.494872:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517018880 00000100:00100000:1.0:1787862763.494947:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:1.0:1787862763.494956:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2345:x1874709517018880:12345-192.168.202.60@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787862763.494988:0:14308:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from ec424a92-b33b-4ce7-b36b-6c8bccbb8254@192.168.202.60@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1787862763.495018:0:14308:0:(genops.c:1385:class_connect()) connect: client ec424a92-b33b-4ce7-b36b-6c8bccbb8254, cookie 0x9c5536ccf893103d 00000100:00080000:1.0:1787862763.495201:0:14308:0:(import.c:65:import_set_state_nolock()) ffff9a65117b4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862763.495273:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+5:2345:x1874709517018880:12345-192.168.202.60@tcp:250:mount.lustre.0 Request processed in 316us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.495281:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:2.0:1787862763.505447:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.505517:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019008 00000100:00100000:1.0:1787862763.505528:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019008 00000100:00100000:1.0:1787862763.505588:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:1.0:1787862763.505600:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+5:13732:x1874709517019008:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787862763.505635:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862763.505654:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfc000/0x9c5536ccf8931044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a5a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862763.505687:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfc000/0x9c5536ccf8931044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a5a expref: 6 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862763.505699:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfc000/0x9c5536ccf8931044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a5a expref: 6 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862763.505709:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc000, rc 0) 00000100:00100000:1.0:1787862763.505770:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+6:13732:x1874709517019008:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 172us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.505778:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:1.0:1787862763.518481:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862763.518564:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019136 00000100:00100000:2.0:1787862763.518576:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019136 00000100:00100000:2.0:1787862763.518637:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:2.0:1787862763.518676:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+6:13732:x1874709517019136:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787862763.519007:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+6:13732:x1874709517019136:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 333us (535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787862763.519016:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:2.0:1787862763.521427:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.521568:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019264 00000100:00100000:3.0:1787862763.521580:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019264 00000100:00100000:3.0:1787862763.521647:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:3.0:1787862763.521659:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+6:13732:x1874709517019264:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787862763.521679:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862763.521713:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422de00/0x9c5536ccf893104b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a61 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862763.521744:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422de00/0x9c5536ccf893104b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a61 expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862763.521757:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422de00/0x9c5536ccf893104b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a61 expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862763.521767:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422de00, rc 0) 00000100:00100000:3.0:1787862763.521842:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+7:13732:x1874709517019264:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 185us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.521849:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:3.0:1787862763.538443:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.538562:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019392 00000100:00100000:1.0:1787862763.538574:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019392 00000100:00100000:1.0:1787862763.538631:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:1.0:1787862763.538941:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+7:13732:x1874709517019392:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787862763.539446:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13732:x1874709517019392:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 804us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.539456:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:1.0:1787862763.544765:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862763.544861:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019520 00000100:00100000:2.0:1787862763.544872:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019520 00000100:00100000:2.0:1787862763.544933:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:2.0:1787862763.544944:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13732:x1874709517019520:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787862763.545423:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13732:x1874709517019520:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 479us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862763.545433:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:2.0:1787862763.553749:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.554756:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019648 00000100:00100000:1.0:1787862763.554769:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019648 00000100:00100000:1.0:1787862763.554839:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:1.0:1787862763.554851:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13750:x1874709517019648:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862763.555218:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13750:x1874709517019648:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 368us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.555226:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:3.0:1787862763.582203:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862763.582882:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019776 00000100:00100000:2.0:1787862763.582899:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019776 00000100:00100000:2.0:1787862763.582985:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:2.0:1787862763.582999:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13750:x1874709517019776:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862763.583989:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13750:x1874709517019776:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 985us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862763.584003:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:0.0:1787862763.589304:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.594124:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517019904 00000100:00100000:3.0:1787862763.594149:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517019904 00000100:00100000:3.0:1787862763.594268:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862763.594283:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+8:13732:x1874709517019904:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787862763.594308:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862763.594334:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8931052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a8b expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862763.594398:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8931052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a8b expref: 9 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862763.594411:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422cc00/0x9c5536ccf8931052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a8b expref: 9 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862763.594421:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422cc00, rc 0) 00000100:00100000:3.0:1787862763.594523:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+9:13732:x1874709517019904:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 243us (5238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.594531:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862763.606780:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.607894:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020032 00000100:00100000:1.0:1787862763.607913:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020032 00000100:00100000:1.0:1787862763.608010:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:1.0:1787862763.608031:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+9:13732:x1874709517020032:12345-192.168.202.60@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787862763.608106:0:14309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787862763.608133:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787862763.608137:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787862763.608141:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787862763.608143:0:14309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787862763.614115:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+9:13732:x1874709517020032:12345-192.168.202.60@tcp:256:mount.lustre.0 Request processed in 6078us (7332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862763.614138:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:0.0:1787862763.635280:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862763.635351:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020160 00000100:00100000:2.0:1787862763.635370:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020160 00000100:00100000:2.0:1787862763.635443:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:2.0:1787862763.635455:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+9:13732:x1874709517020160:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862763.635474:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862763.635510:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34a92 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862763.635549:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 10 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862763.635564:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 10 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862763.635574:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919800, rc 0) 00000100:00100000:2.0:1787862763.635661:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13732:x1874709517020160:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 209us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862763.635670:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:2.0:1787862763.639791:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862763.640113:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020288 00000100:00100000:0.0:1787862763.640129:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020288 00000100:00100000:1.0:1787862763.640302:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:1.0:1787862763.640344:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13732:x1874709517020288:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787862763.640992:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13732:x1874709517020288:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 664us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.641003:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:1.0:1787862763.643950:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862763.644138:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020416 00000100:00100000:2.0:1787862763.644154:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020416 00000100:00100000:2.0:1787862763.644232:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:2.0:1787862763.644252:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13732:x1874709517020416:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787862763.644645:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13732:x1874709517020416:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 402us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862763.644656:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:0.0:1787862763.648533:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.649211:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020544 00000100:00100000:1.0:1787862763.649237:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020544 00000100:00100000:1.0:1787862763.649375:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:1.0:1787862763.649386:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13755:x1874709517020544:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862763.650354:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13755:x1874709517020544:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 959us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.650368:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:1.0:1787862763.670438:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.670685:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020672 00000100:00100000:3.0:1787862763.670700:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020672 00000100:00100000:3.0:1787862763.670782:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:3.0:1787862763.670795:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13755:x1874709517020672:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862763.671191:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13755:x1874709517020672:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 398us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.671201:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:2.0:1787862763.682798:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.683090:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020800 00000100:00100000:1.0:1787862763.683109:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020800 00000100:00100000:1.0:1787862763.683196:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:1.0:1787862763.683208:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1874709517020800:12345-192.168.202.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787862763.683261:0:15473:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1787862763.683340:0:15473:0:(genops.c:1385:class_connect()) connect: client 7a16fbf5-07bd-4add-b9e9-3111232e9331, cookie 0x9c5536ccf8931060 00000004:00100000:1.0:1787862763.683388:0:15473:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1787862763.683396:0:15473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787862763.704828:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862763.704871:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526459264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862763.710791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862763.711728:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459264 00000100:00100000:1.0:1787862763.711742:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459264 00000100:00100000:1.0:1787862763.711862:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787862763.711875:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526459264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862763.711922:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862763.712000:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526459264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.712009:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787862763.712115:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526459264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787862763.742077:0:15473:0:(import.c:65:import_set_state_nolock()) ffff9a65117b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787862763.742886:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2345:x1874709517020800:12345-192.168.202.60@tcp:38:mount.lustre.0 Request processed in 59673us (60097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.742901:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:0.0:1787862763.747021:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.747262:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517020928 00000100:00100000:1.0:1787862763.747280:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517020928 00000100:00080000:0.0:1787862763.747389:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862763.747466:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:3.0:1787862763.747488:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:0:x1874709517020928:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787862763.747576:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787862763.747703:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:0:x1874709517020928:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 223us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.747712:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:2.0:1787862763.749218:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862763.749387:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021056 00000100:00100000:1.0:1787862763.749401:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021056 00000100:00100000:1.0:1787862763.749508:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:1.0:1787862763.749519:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13732:x1874709517021056:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787862763.749587:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862763.749677:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13732:x1874709517021056:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 159us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.749684:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:2.0:1787862763.763794:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.765465:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021184 00000100:00100000:3.0:1787862763.765484:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021184 00000100:00100000:3.0:1787862763.765645:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1787862763.765657:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13732:x1874709517021184:12345-192.168.202.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787862763.765901:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13732:x1874709517021184:12345-192.168.202.60@tcp:40:mount.lustre.0 Request processed in 245us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.765910:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1787862763.769241:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.769282:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.769320:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862763.769352:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021312 00000100:00100000:3.0:1787862763.769363:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021312 00000100:00100000:3.0:1787862763.769402:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021440 00000100:00100000:3.0:1787862763.769405:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021440 00000100:00100000:3.0:1787862763.769421:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862763.769429:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709517021312:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787862763.769466:0:14998:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1787862763.769502:0:14998:0:(genops.c:1385:class_connect()) connect: client 7a16fbf5-07bd-4add-b9e9-3111232e9331, cookie 0x9c5536ccf8931067 00002000:00100000:3.0:1787862763.769528:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a16fbf5-07bd-4add-b9e9-3111232e9331/ffff9a6401bc6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862763.769541:0:14998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787862763.769897:0:14998:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787862763.769947:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862763.770012:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2345:x1874709517021312:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 582us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.770021:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862763.770073:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:3.0:1787862763.770079:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709517021440:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787862763.770095:0:14998:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1787862763.770112:0:14998:0:(genops.c:1385:class_connect()) connect: client 7a16fbf5-07bd-4add-b9e9-3111232e9331, cookie 0x9c5536ccf893106e 00002000:00100000:3.0:1787862763.770118:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a16fbf5-07bd-4add-b9e9-3111232e9331/ffff9a6401bc5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787862763.770124:0:14998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787862763.770380:0:14998:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787862763.770397:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862763.770423:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2345:x1874709517021440:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 342us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862763.770431:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:1.0:1787862763.770615:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021568 00000100:00100000:1.0:1787862763.770622:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021568 00000100:00100000:1.0:1787862763.770665:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:1.0:1787862763.770673:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13732:x1874709517021568:12345-192.168.202.60@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787862763.774235:0:14317:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3493us 00000004:00200000:1.0:1787862763.805711:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787862763.805930:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13732:x1874709517021568:12345-192.168.202.60@tcp:33:mount.lustre.0 Request processed in 35251us (36702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862763.805943:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00010000:00010000:3.0:1787862763.868890:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862764.040121:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862764.046951:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021696 00000100:00100000:2.0:1787862764.046976:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021696 00000100:00100000:2.0:1787862764.047116:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:2.0:1787862764.047135:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13776:x1874709517021696:12345-192.168.202.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787862764.047188:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862764.047568:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8931075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34abc expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862764.047662:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf893107c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862764.047679:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf893107c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862764.047697:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf893107c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862764.048002:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862764.048007:0:15473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862764.048149:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf893107c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862764.048182:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf8931075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34abc expref: 8 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862764.048200:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf893107c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34abc expref: 7 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862764.048209:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862764.048212:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862764.048217:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918800, rc 0) 00000100:00100000:2.0:1787862764.048745:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:13776:x1874709517021696:12345-192.168.202.60@tcp:101:mkdir.0 Request processed in 1610us (8632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862764.048756:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000040:00080000:2.0:1787862764.316909:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787862764.892687:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787862765.814359:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a16fbf5-07bd-4add-b9e9-3111232e9331 00010000:00010000:3.0:1787862765.921370:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862766.074937:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.075288:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021824 00000100:00100000:1.0:1787862766.075301:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021824 00000100:00100000:1.0:1787862766.075399:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862766.075410:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:13828:x1874709517021824:12345-192.168.202.60@tcp:41:lfs.0 00000004:00000024:1.0:1787862766.075489:0:14315:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787862766.075635:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:13828:x1874709517021824:12345-192.168.202.60@tcp:41:lfs.0 Request processed in 226us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.075644:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:0.0:1787862766.077750:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862766.081159:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.082675:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517021952 00000100:00100000:1.0:1787862766.082697:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517021952 00000100:00100000:1.0:1787862766.082849:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00080000:0.0:1787862766.082970:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862766.083164:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:13828:x1874709517021952:12345-192.168.202.60@tcp:13:lfs.0 00002000:00000024:1.0:1787862766.083223:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862766.083364:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:13828:x1874709517021952:12345-192.168.202.60@tcp:13:lfs.0 Request processed in 205us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.091668:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.099585:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787862766.099615:0:15002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787862766.100121:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:1.0:1787862766.100164:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022080 00000100:00100000:1.0:1787862766.100176:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022080 00000100:00100000:1.0:1787862766.100249:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862766.100262:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13828:x1874709517022080:12345-192.168.202.60@tcp:13:lfs.0 00002000:00000024:1.0:1787862766.100316:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862766.100444:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:13828:x1874709517022080:12345-192.168.202.60@tcp:13:lfs.0 Request processed in 185us (8794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.100452:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:3.0:1787862766.100756:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862766.271131:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.271249:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022208 00000100:00100000:1.0:1787862766.271265:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022208 00000100:00100000:1.0:1787862766.272622:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:1.0:1787862766.272644:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+10:13860:x1874709517022208:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787862766.272669:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862766.272694:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfd600/0x9c5536ccf8931083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34ac3 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.272733:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfd600/0x9c5536ccf8931083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ac3 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.272747:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfd600/0x9c5536ccf8931083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ac3 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.272794:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd600, rc 0) 00000100:00100000:1.0:1787862766.272956:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13860:x1874709517022208:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 319us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.272965:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:1.0:1787862766.288281:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.288561:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022336 00000100:00100000:2.0:1787862766.288577:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022336 00000100:00100000:2.0:1787862766.288659:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:2.0:1787862766.288671:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13860:x1874709517022336:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787862766.289233:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13860:x1874709517022336:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 562us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862766.289244:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:2.0:1787862766.309274:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.309405:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022464 00000100:00100000:1.0:1787862766.309419:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022464 00000100:00100000:1.0:1787862766.309506:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:1.0:1787862766.309520:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13860:x1874709517022464:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787862766.310003:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13860:x1874709517022464:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 485us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.310012:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:0.0:1787862766.330021:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862766.330310:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022592 00000100:00100000:3.0:1787862766.330323:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022592 00000100:00100000:3.0:1787862766.330402:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:3.0:1787862766.330415:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13867:x1874709517022592:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787862766.330940:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13867:x1874709517022592:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 524us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.330961:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:0.0:1787862766.349404:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.351914:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022720 00000100:00100000:1.0:1787862766.351938:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022720 00000100:00100000:1.0:1787862766.352086:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:1.0:1787862766.352101:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13867:x1874709517022720:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862766.352540:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13867:x1874709517022720:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 440us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.352551:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:0.0:1787862766.361244:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.361373:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022848 00000100:00100000:2.0:1787862766.361389:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022848 00000100:00100000:2.0:1787862766.361465:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:2.0:1787862766.361483:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13860:x1874709517022848:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787862766.361508:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862766.361538:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c919400/0x9c5536ccf893108a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34aed expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862766.361577:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c919400/0x9c5536ccf893108a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34aed expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862766.361590:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c919400/0x9c5536ccf893108a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34aed expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862766.361613:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919400, rc 0) 00000100:00100000:2.0:1787862766.361718:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13860:x1874709517022848:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 242us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862766.361726:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:0.0:1787862766.367844:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862766.367957:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517022976 00000100:00100000:3.0:1787862766.367971:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517022976 00000100:00100000:3.0:1787862766.368087:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:3.0:1787862766.368101:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13860:x1874709517022976:12345-192.168.202.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787862766.368138:0:14307:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787862766.368174:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787862766.368179:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787862766.368182:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787862766.368185:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787862766.375072:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13860:x1874709517022976:12345-192.168.202.60@tcp:256:mount.lustre.0 Request processed in 6935us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.375092:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:0.0:1787862766.379463:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.379723:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023104 00000100:00100000:1.0:1787862766.379736:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023104 00000100:00100000:1.0:1787862766.379824:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:1.0:1787862766.379836:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13860:x1874709517023104:12345-192.168.202.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787862766.379861:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862766.380110:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34af4 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.380154:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.380169:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.380180:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfca00, rc 0) 00000100:00100000:1.0:1787862766.380378:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13860:x1874709517023104:12345-192.168.202.60@tcp:101:mount.lustre.0 Request processed in 542us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.380386:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:0.0:1787862766.388713:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862766.388892:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023232 00000100:00100000:3.0:1787862766.388906:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023232 00000100:00100000:3.0:1787862766.388997:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:3.0:1787862766.389011:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13860:x1874709517023232:12345-192.168.202.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787862766.391177:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13860:x1874709517023232:12345-192.168.202.60@tcp:501:mount.lustre.0 Request processed in 461us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.391212:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:0.0:1787862766.393827:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.394669:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023360 00000100:00100000:1.0:1787862766.394683:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023360 00000100:00100000:1.0:1787862766.394770:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:1.0:1787862766.394792:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13860:x1874709517023360:12345-192.168.202.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787862766.395241:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13860:x1874709517023360:12345-192.168.202.60@tcp:503:mount.lustre.0 Request processed in 458us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.395251:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:0.0:1787862766.402969:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.406559:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023488 00000100:00100000:1.0:1787862766.406583:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023488 00000100:00100000:1.0:1787862766.406686:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787862766.406699:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13871:x1874709517023488:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787862766.407195:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13871:x1874709517023488:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 496us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.407206:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:0.0:1787862766.426921:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.427076:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023616 00000100:00100000:2.0:1787862766.427090:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023616 00000100:00100000:2.0:1787862766.427211:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:2.0:1787862766.427236:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13871:x1874709517023616:12345-192.168.202.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787862766.427629:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13871:x1874709517023616:12345-192.168.202.60@tcp:502:llog_process_th.0 Request processed in 395us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862766.427639:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:2.0:1787862766.442643:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.442702:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.442740:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862766.443108:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023744 00000100:00100000:3.0:1787862766.443121:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023744 00000100:00100000:3.0:1787862766.443171:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517023872 00000100:00100000:3.0:1787862766.443174:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517023872 00000100:00100000:3.0:1787862766.443215:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1787862766.443238:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2347:x1874709517023872:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862766.443360:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2347:x1874709517023872:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 124us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.443369:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1787862766.443389:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862766.443394:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1874709517023744:12345-192.168.202.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787862766.443422:0:15473:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf@192.168.202.60@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:3.0:1787862766.443468:0:15473:0:(genops.c:1385:class_connect()) connect: client 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf, cookie 0x9c5536ccf8931098 00000004:00100000:3.0:1787862766.443517:0:15473:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787862766.443685:0:15473:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787862766.443715:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2345:x1874709517023744:12345-192.168.202.60@tcp:38:mount.lustre.0 Request processed in 320us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.443723:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:2.0:1787862766.443975:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862766.444279:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024128 00000100:00100000:0.0:1787862766.444287:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024128 00000100:00100000:0.0:1787862766.444331:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024000 00000100:00100000:0.0:1787862766.444336:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024000 00000100:00100000:0.0:1787862766.444354:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787862766.444362:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517024128:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862766.444408:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517024128:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 47us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862766.444416:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787862766.444429:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:0.0:1787862766.444436:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2347:x1874709517024000:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862766.444459:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2347:x1874709517024000:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862766.444465:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:2.0:1787862766.447744:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.447847:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862766.451075:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024256 00000100:00100000:3.0:1787862766.451095:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024256 00000100:00080000:1.0:1787862766.451288:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862766.451346:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024384 00000100:00100000:3.0:1787862766.451351:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024384 00000100:00100000:0.0:1787862766.451448:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:0.0:1787862766.451464:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+7:0:x1874709517024256:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787862766.451527:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787862766.451630:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+7:0:x1874709517024256:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 171us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862766.451639:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:0.0:1787862766.451658:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787862766.451695:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13860:x1874709517024384:12345-192.168.202.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787862766.451706:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787862766.451727:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13860:x1874709517024384:12345-192.168.202.60@tcp:41:mount.lustre.0 Request processed in 35us (3880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862766.451734:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787862766.454506:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.455552:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024512 00000100:00100000:2.0:1787862766.455571:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024512 00000100:00100000:2.0:1787862766.455653:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787862766.455666:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13860:x1874709517024512:12345-192.168.202.60@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787862766.456065:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13860:x1874709517024512:12345-192.168.202.60@tcp:40:mount.lustre.0 Request processed in 399us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862766.456083:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862766.459032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862766.459223:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024640 00000100:00100000:0.0:1787862766.459246:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024640 00000100:00100000:0.0:1787862766.459308:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787862766.459319:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874709517024640:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787862766.459372:0:14998:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf@192.168.202.60@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1787862766.459417:0:14998:0:(genops.c:1385:class_connect()) connect: client 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf, cookie 0x9c5536ccf893109f 00002000:00100000:0.0:1787862766.459434:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf/ffff9a652731d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787862766.459448:0:14998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787862766.459795:0:14998:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787862766.459838:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a652731c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787862766.459942:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2345:x1874709517024640:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 622us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862766.459952:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787862766.464881:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862766.464942:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862766.465105:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024768 00000100:00100000:2.0:1787862766.465120:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024768 00000100:00100000:2.0:1787862766.465170:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787862766.465181:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874709517024768:12345-192.168.202.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787862766.465243:0:15000:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf@192.168.202.60@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1787862766.465284:0:15000:0:(genops.c:1385:class_connect()) connect: client 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf, cookie 0x9c5536ccf89310a6 00002000:00100000:2.0:1787862766.465299:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf/ffff9a6504e6c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787862766.465313:0:15000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787862766.465486:0:15000:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787862766.465526:0:15000:0:(import.c:65:import_set_state_nolock()) ffff9a6504e69000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787862766.465618:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2345:x1874709517024768:12345-192.168.202.60@tcp:8:mount.lustre.0 Request processed in 437us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862766.465627:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:3.0:1787862766.465796:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517024896 00000100:00100000:3.0:1787862766.465802:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517024896 00000100:00100000:3.0:1787862766.465856:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:3.0:1787862766.465864:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13860:x1874709517024896:12345-192.168.202.60@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787862766.466260:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787862766.466497:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13860:x1874709517024896:12345-192.168.202.60@tcp:33:mount.lustre.0 Request processed in 633us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862766.466507:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1787862766.623446:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862766.627147:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025024 00000100:00100000:1.0:1787862766.627236:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025024 00000100:00100000:1.0:1787862766.627351:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:1.0:1787862766.627364:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:13892:x1874709517025024:12345-192.168.202.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787862766.627391:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862766.627421:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf89310ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b1e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.627956:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.627980:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.627999:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862766.631394:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787862766.631415:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862766.631988:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.632073:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf89310ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.632100:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862766.632127:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:1.0:1787862766.632131:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862766.632137:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc800, rc 0) 00000100:00100000:1.0:1787862766.635596:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+7:13892:x1874709517025024:12345-192.168.202.60@tcp:101:mkdir.0 Request processed in 8214us (12145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862766.635618:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00010000:00010000:1.0:1787862766.942142:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862767.773258:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526459392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862767.773341:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862767.773459:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459392 00000100:00100000:0.0:1787862767.773467:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459392 00000100:00100000:0.0:1787862767.773535:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787862767.773547:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526459392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862767.773603:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862767.773654:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526459392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862767.773662:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787862767.773719:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862767.773755:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526459648:0@lo:400:kworker.0 00000100:00100000:1.0:1787862767.773760:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787862767.773815:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526459392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862767.773827:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862767.773829:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862767.773835:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526459520:0@lo:400:kworker.0 00000100:00100000:1.0:1787862767.773907:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862767.773943:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459648 00000100:00100000:1.0:1787862767.773948:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459648 00000100:00100000:1.0:1787862767.773985:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787862767.773992:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526459648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.776626:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526459776:0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.776802:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862767.776893:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526460032:0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.776923:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862767.776945:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862767.776952:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526459904:0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.776974:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862767.777004:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459776 00000100:00100000:3.0:1787862767.777013:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459776 00000100:00100000:3.0:1787862767.777092:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460032 00000100:00100000:3.0:1787862767.777096:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460032 00000100:00100000:3.0:1787862767.777114:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459904 00000100:00100000:3.0:1787862767.777117:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459904 00000100:00100000:3.0:1787862767.777133:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787862767.777142:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526459776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.777202:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526459776:12345-0@lo:400:kworker.0 Request processed in 59us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862767.777227:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787862767.777245:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787862767.777251:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526460032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.777280:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526460032:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862767.777287:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787862767.777297:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787862767.777303:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.777597:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526459904:12345-0@lo:400:kworker.0 Request processed in 293us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862767.777615:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787862767.777679:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526459776:0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.777708:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526459904:0@lo:400:kworker.0 00000100:00100000:3.0:1787862767.777717:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526460032:0@lo:400:kworker.0 00000100:00100000:1.0:1787862767.779688:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526459648:12345-0@lo:400:kworker.0 Request processed in 5684us (5847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862767.779705:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787862767.779742:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526459648:0@lo:400:kworker.0 00000100:00100000:1.0:1787862767.779759:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526459520 00000100:00100000:1.0:1787862767.780676:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526459520 00000100:00100000:1.0:1787862767.780749:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787862767.780781:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526459520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787862767.780861:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862767.780870:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862767.780992:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526459520:12345-0@lo:400:kworker.0 Request processed in 226us (7085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862767.780998:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787862767.781069:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526459520:0@lo:400:kworker.0 00000001:00100000:3.0:1787862767.863912:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000001:00100000:3.0:1787862767.863930:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a16fbf5-07bd-4add-b9e9-3111232e9331 00010000:00010000:3.0:1787862767.970148:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862768.798007:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526460160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862768.798119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862768.800080:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460160 00000100:00100000:2.0:1787862768.800096:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460160 00000100:00100000:2.0:1787862768.800239:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787862768.800255:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526460160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862768.802614:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862768.802740:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526460160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2484us (4616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862768.802752:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787862768.804442:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526460160:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787862768.900022:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a16fbf5-07bd-4add-b9e9-3111232e9331 00000001:00100000:1.0:1787862768.900063:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00010000:00010000:1.0:1787862768.988685:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862770.015396:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787862770.412780:0:16286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787862771.035811:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00010000:00010000:1.0:1787862771.036530:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862771.914230:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.914344:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025152 00000100:00100000:3.0:1787862771.914358:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025152 00000100:00100000:3.0:1787862771.914428:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:3.0:1787862771.914441:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517025152:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862771.914771:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517025152:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 330us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862771.914783:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:3.0:1787862771.923362:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.923402:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.923435:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.923454:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.923471:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.923494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862771.923536:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025664 00000100:00100000:3.0:1787862771.923551:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025664 00000100:00100000:0.0:1787862771.923658:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025408 00000100:00100000:0.0:1787862771.923665:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025408 00000100:00100000:0.0:1787862771.923759:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025920 00000100:00100000:0.0:1787862771.923762:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025920 00000100:00100000:0.0:1787862771.923783:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025536 00000100:00100000:0.0:1787862771.923785:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025536 00000100:00100000:0.0:1787862771.923799:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025792 00000100:00100000:0.0:1787862771.923801:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025792 00000100:00100000:0.0:1787862771.923823:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:0.0:1787862771.923837:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2349:x1874709517025408:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862771.923866:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517025280 00000100:00100000:3.0:1787862771.923870:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517025280 00000100:00100000:3.0:1787862771.923918:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:3.0:1787862771.923926:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517025664:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862771.923961:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517025664:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 37us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862771.923961:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2349:x1874709517025408:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 127us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862771.923969:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862771.923970:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1787862771.923989:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787862771.923989:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862771.923996:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517025280:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862771.924002:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2349:x1874709517025920:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862771.924019:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517025280:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862771.924023:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2349:x1874709517025920:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 22us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862771.924026:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787862771.924028:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:0.0:1787862771.924037:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:0.0:1787862771.924073:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517025536:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862771.924097:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517025536:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 54us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862771.924104:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:0.0:1787862771.924114:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787862771.924120:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2348:x1874709517025792:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862771.924143:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2348:x1874709517025792:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862771.924148:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00080000:0.0:1787862771.924171:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862771.924179:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862771.924181:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787862772.063141:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862772.893359:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862772.893385:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526460288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862772.893469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862772.893627:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460288 00000100:00100000:1.0:1787862772.893636:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460288 00000100:00100000:1.0:1787862772.893698:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787862772.893708:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526460288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862772.893754:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862772.893803:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526460288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862772.893811:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787862772.893864:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862772.893906:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526460288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862772.894165:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526460544:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894202:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862772.894224:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862772.894230:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526460416:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894255:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862772.894392:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526460928:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894423:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862772.894449:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526460800:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894473:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862772.894494:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862772.894500:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526460672:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894521:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862772.894546:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460544 00000100:00100000:2.0:1787862772.894551:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460544 00000100:00100000:2.0:1787862772.894591:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862772.894599:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894638:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526460544:12345-0@lo:400:kworker.0 Request processed in 40us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862772.894644:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862772.894662:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460416 00000100:00100000:2.0:1787862772.894665:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460416 00000100:00100000:2.0:1787862772.894687:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862772.894693:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526460416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894732:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526460416:12345-0@lo:400:kworker.0 Request processed in 39us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862772.894739:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862772.894766:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460928 00000100:00100000:2.0:1787862772.894775:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460928 00000100:00100000:2.0:1787862772.894804:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460800 00000100:00100000:2.0:1787862772.894807:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460800 00000100:00100000:2.0:1787862772.894821:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526460672 00000100:00100000:2.0:1787862772.894824:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526460672 00000100:00100000:2.0:1787862772.894835:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862772.894841:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526460928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894871:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526460928:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862772.894877:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787862772.894889:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862772.894895:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526460800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894924:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526460800:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862772.894929:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862772.894941:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787862772.894946:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526460672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.894967:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526460672:12345-0@lo:400:kworker.0 Request processed in 22us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862772.894973:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787862772.895002:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862772.895006:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862772.895025:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526460672:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.895036:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526460800:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.895088:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526460416:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.895097:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526460928:0@lo:400:kworker.0 00000100:00100000:2.0:1787862772.895115:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526460544:0@lo:400:kworker.0 00010000:00010000:1.0:1787862773.085330:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862773.917459:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862773.917486:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65115461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526461056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862773.917568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862773.918226:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526461056 00000100:00100000:2.0:1787862773.918236:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526461056 00000100:00100000:2.0:1787862773.918361:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787862773.918372:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526461056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862773.918409:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862773.918462:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526461056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862773.918469:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787862773.918683:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65115461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526461056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862774.111248:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862774.557666:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1787862774.818743:0:16435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1c93c690 20000000:00000080:3.0:1787862774.818762:0:16435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6401b57400 uarg=0000000000000000 20000000:01000000:3.0:1787862774.818802:0:16435:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787862774.818808:0:16435:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787862774.818813:0:16435:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787862774.820764:0:16436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787862774.820919:0:16435:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787862774.831797:0:16435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787862774.831841:0:16435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831867:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 18 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831877:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831886:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831918:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831927:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831935:0:16435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.831981:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.832000:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 12 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.832019:0:16435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461184:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862774.833238:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.833252:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 12 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.833266:0:16435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461312:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862774.833300:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.833308:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 18 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.833332:0:16435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461440:0@lo:104: 00000100:00100000:3.0:1787862774.833374:0:16435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862774.833558:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526461440 00000100:00100000:3.0:1787862774.833565:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526461440 00000100:00100000:3.0:1787862774.833615:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787862774.833625:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:16435:x1874709526461440:12345-0@lo:104: 00010000:00010000:3.0:1787862774.833639:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.833695:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862774.833711:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:16435:x1874709526461440:12345-0@lo:104: Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862774.833718:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787862774.833757:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.833766:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 18 pid: 14307 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.833775:0:16435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461568:0@lo:104: 00000100:00100000:3.0:1787862774.833798:0:16435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862774.833816:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526461568 00000100:00100000:3.0:1787862774.833819:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526461568 00000100:00100000:3.0:1787862774.833841:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787862774.833848:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:16435:x1874709526461568:12345-0@lo:104: 00010000:00010000:3.0:1787862774.833856:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.833900:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787862774.833905:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:16435:x1874709526461568:12345-0@lo:104: Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862774.833911:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787862774.833940:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 18 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.833949:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 18 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.833957:0:16435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461696:0@lo:104: 00000100:00100000:3.0:1787862774.833984:0:16435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787862774.834342:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787862774.834349:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834357:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862774.834367:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834375:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862774.834382:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862774.834388:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787862774.834439:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834446:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862774.834466:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834472:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a653422da00/0x9c5536ccf8930f2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930f33 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834486:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862774.834489:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834495:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ca00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862774.834498:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834504:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862774.834521:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862774.834526:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787862774.834540:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834545:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862774.834551:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834557:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a653422ca00/0x9c5536ccf8930df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930dff expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834566:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862774.834567:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862774.834569:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862774.834576:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862774.834594:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526461824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862774.834629:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862774.834656:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862774.834662:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526461952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862774.834681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862774.834720:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526461824 00000100:00100000:1.0:1787862774.834724:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526461824 00010000:00010000:1.0:1787862774.834745:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 19 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862774.834765:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526461952 00000100:00100000:1.0:1787862774.834774:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526461952 00010000:00010000:1.0:1787862774.834789:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 20 pid: 14307 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862774.834801:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862774.834807:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+20:3283:x1874709526461824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862774.834818:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862774.834822:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 20 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834832:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 20 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834848:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862774.834873:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+20:3283:x1874709526461824:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862774.834879:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787862774.834893:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862774.834898:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526461952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862774.834905:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862774.834909:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 19 pid: 14307 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834916:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 19 pid: 14307 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.834925:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862774.834944:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526461952:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862774.834949:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787862774.834995:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526461952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862774.835005:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526461824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787862774.835368:0:14297:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787862774.835381:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526461696 00000100:00100000:3.0:1787862774.835384:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526461696 00000100:00100000:3.0:1787862774.835690:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862774.835699:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:16435:x1874709526461696:12345-0@lo:104: 00010000:00010000:3.0:1787862774.835721:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862774.835762:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787862774.835768:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65056cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+3:16435:x1874709526461696:12345-0@lo:104: Request processed in 72us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862774.835774:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862774.835842:0:16435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517abc900 going to sleep for 11 seconds 00010000:00010000:3.0:1787862774.835857:0:16435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6534636a00/0x9c5536ccf8930f33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930f2c expref: 18 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.835878:0:16435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461440:0@lo:104: 00010000:00010000:3.0:1787862774.835888:0:16435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422c800/0x9c5536ccf8930dff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930df8 expref: 17 pid: 14307 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862774.835895:0:16435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461568:0@lo:104: 00000100:00100000:3.0:1787862774.835902:0:16435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461696:0@lo:104: 00010000:00010000:1.0:1787862774.835949:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862774.835955:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.835962:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918e00 already unused, calling callback (ffffffffc1b06c20) 10000000:00010000:1.0:1787862774.835965:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.835973:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787862774.835980:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787862774.835986:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787862774.836183:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.836190:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787862774.836215:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.836223:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.160@tcp lock: ffff9a651c918e00/0x9c5536ccf8930dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c5536ccf8930db2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.836238:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862774.836240:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862774.836242:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862774.836254:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862774.836266:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526462080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787862774.836302:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862774.836326:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462080 00000100:00100000:1.0:1787862774.836329:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462080 00010000:00010000:1.0:1787862774.836343:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 17 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862774.836361:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787862774.836366:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:3282:x1874709526462080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787862774.836375:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862774.836379:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 17 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.836387:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 17 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.837544:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6401b78c00/0x9c5536ccf8930db2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c5536ccf8930dab expref: 17 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.837563:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862774.837619:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:3282:x1874709526462080:12345-0@lo:103:ldlm_bl.0 Request processed in 1251us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862774.837627:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787862774.838689:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526462080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787862774.841716:0:16435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461184:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862774.841732:0:16435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1874709526461312:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862774.841776:0:16435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862774.843368:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862774.843392:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862774.843495:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026048 00000100:00100000:1.0:1787862774.843504:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026048 00010000:00010000:1.0:1787862774.843541:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 13 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862774.843576:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026176 00000100:00100000:1.0:1787862774.843587:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026176 00010000:00010000:1.0:1787862774.843597:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 14 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862774.843612:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:1.0:1787862774.843620:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+14:2348:x1874709517026048:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862774.843637:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862774.843642:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 14 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843655:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 14 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843675:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6509bfca00/0x9c5536ccf8931091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34af4 expref: 14 pid: 14309 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843689:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862774.843753:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517026048:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862774.843761:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:1.0:1787862774.843776:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:1.0:1787862774.843782:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a41a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:2348:x1874709517026176:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862774.843788:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862774.843792:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 12 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843801:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 12 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843821:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a651c919800/0x9c5536ccf8931059 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34a92 expref: 12 pid: 14308 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843831:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843840:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843855:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843862:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843870:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843877:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843883:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862774.843887:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843896:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843906:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862774.843924:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862774.843939:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a41a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:2348:x1874709517026176:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 157us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862774.843945:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00010000:00010000:0.0:1787862774.844097:0:16435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862774.844111:0:16435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862774.844118:0:16435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a653422ce00/0x9c5536ccf89310bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862775.132875:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862776.157475:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862776.460408:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862776.460454:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026304 00000100:00100000:2.0:1787862776.460463:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026304 00000100:00100000:2.0:1787862776.460514:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:2.0:1787862776.461311:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+11:13746:x1874709517026304:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862776.461332:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862776.461354:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918e00/0x9c5536ccf89310c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b25 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862776.461397:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918e00/0x9c5536ccf89310c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b25 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862776.461409:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918e00/0x9c5536ccf89310c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b25 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862776.461421:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918e00, rc 0) 00000100:00100000:2.0:1787862776.461494:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13746:x1874709517026304:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 971us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862776.461502:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:0.0:1787862776.465365:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862776.471534:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026432 00000100:00100000:2.0:1787862776.471550:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026432 00000100:00100000:2.0:1787862776.471607:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:2.0:1787862776.471618:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13746:x1874709517026432:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787862776.471927:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13746:x1874709517026432:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 310us (6573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862776.471936:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:3.0:1787862776.477931:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862776.477979:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026560 00000100:00100000:3.0:1787862776.477990:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026560 00000100:00100000:3.0:1787862776.478064:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:3.0:1787862776.478075:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13746:x1874709517026560:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.478327:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13746:x1874709517026560:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 253us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.478335:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:2.0:1787862776.485892:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862776.486022:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026688 00000100:00100000:2.0:1787862776.486033:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026688 00000100:00100000:2.0:1787862776.486104:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 110 00000100:00100000:2.0:1787862776.486115:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+12:13746:x1874709517026688:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787862776.487280:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862776.487305:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a651c918600/0x9c5536ccf89310c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b2c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862776.487340:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a651c918600/0x9c5536ccf89310c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b2c expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862776.487351:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a651c918600/0x9c5536ccf89310c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b2c expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862776.487361:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918600, rc 0) 00000100:00100000:2.0:1787862776.487493:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13746:x1874709517026688:12345-192.168.202.60@tcp:101:ll_cfg_requeue.0 Request processed in 1379us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862776.487507:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 110 00000100:00100000:2.0:1787862776.499275:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862776.499462:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026816 00000100:00100000:3.0:1787862776.499473:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026816 00000100:00100000:3.0:1787862776.499526:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 111 00000100:00100000:3.0:1787862776.499536:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13746:x1874709517026816:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.500197:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13746:x1874709517026816:12345-192.168.202.60@tcp:501:ll_cfg_requeue.0 Request processed in 660us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.500207:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 111 00000100:00100000:3.0:1787862776.506020:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862776.506125:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517026944 00000100:00100000:2.0:1787862776.506137:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517026944 00000100:00100000:2.0:1787862776.506196:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:2.0:1787862776.506206:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13746:x1874709517026944:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787862776.506462:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:13746:x1874709517026944:12345-192.168.202.60@tcp:503:ll_cfg_requeue.0 Request processed in 256us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862776.506471:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 10000000:01000000:0.0:1787862776.562997:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862776.563004:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650741b800 from 10 10000000:01000000:0.0:1787862776.563009:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862776.563079:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.563092:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.563104:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862776.563131:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.563220:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862776.563271:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787862776.563513:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462208 00000100:00100000:3.0:1787862776.563597:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462208 00000100:00100000:3.0:1787862776.563657:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787862776.563666:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+16:14311:x1874709526462208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862776.563680:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862776.563703:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422c800/0x9c5536ccf89310d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89310d0 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.563729:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422c800/0x9c5536ccf89310d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89310d0 expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.563740:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422c800/0x9c5536ccf89310d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89310d0 expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.563749:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c800, rc 0) 00000100:00100000:3.0:1787862776.563794:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14311:x1874709526462208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.563800:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787862776.563846:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862776.563861:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.563871:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862776.563924:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.564017:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862776.564034:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651039c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862776.564070:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462336 00000100:00100000:3.0:1787862776.564080:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462336 00000100:00100000:3.0:1787862776.564102:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787862776.564107:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14311:x1874709526462336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.567245:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14311:x1874709526462336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3127us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.567261:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862776.573486:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787862776.581166:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862776.581674:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862776.581726:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65102a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862776.583661:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462464 00000100:00100000:3.0:1787862776.583675:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462464 00000100:00100000:3.0:1787862776.583733:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787862776.583744:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14311:x1874709526462464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.585426:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14311:x1874709526462464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1675us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.585440:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787862776.586022:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787862776.597224:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787862776.600088:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787862776.600124:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787862776.600139:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.600153:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534636200/0x9c5536ccf89310d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310d7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787862776.600164:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787862776.600167:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650610b000 from 10 10000000:01000000:3.0:1787862776.600171:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787862776.601312:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.601336:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.601348:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862776.601373:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.601444:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862776.601481:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651039c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862776.601506:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462592 00000100:00100000:3.0:1787862776.601513:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462592 00000100:00100000:3.0:1787862776.601558:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787862776.601567:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+17:14311:x1874709526462592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862776.601581:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862776.601593:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a653422c000/0x9c5536ccf89310e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89310de expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.601618:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a653422c000/0x9c5536ccf89310e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89310de expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.601629:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a653422c000/0x9c5536ccf89310e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89310de expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.601638:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422c000, rc 0) 00000100:00100000:3.0:1787862776.601677:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526462592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.601694:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787862776.601752:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787862776.601768:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862776.601777:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862776.601832:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.601858:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862776.601870:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651039c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787862776.601883:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462720 00000100:00100000:3.0:1787862776.601886:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462720 00000100:00100000:3.0:1787862776.601907:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787862776.601912:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526462720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.602208:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526462720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.602215:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787862776.603927:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.603990:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.604078:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862776.604101:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787862776.605667:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462848 00000100:00100000:3.0:1787862776.605680:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462848 00000100:00100000:3.0:1787862776.605740:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787862776.605749:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526462848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787862776.610384:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526462848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4627us (6297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862776.610399:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787862776.610766:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787862776.614144:0:16501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787862776.614204:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787862776.614223:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862776.614235:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.614247:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a653422d000/0x9c5536ccf89310de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310e5 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787862776.614257:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787862776.614260:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a650ac37800 from 10 10000000:01000000:0.0:1787862776.614263:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787862776.614302:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.614323:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.614333:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862776.614357:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.614429:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862776.614467:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787862776.614485:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526462976 00000100:00100000:0.0:1787862776.614492:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526462976 00000100:00100000:0.0:1787862776.614533:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787862776.614542:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+18:14311:x1874709526462976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862776.614555:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862776.614568:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6534636e00/0x9c5536ccf89310f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c5536ccf89310ec expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.614592:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6534636e00/0x9c5536ccf89310f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c5536ccf89310ec expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.614604:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6534636e00/0x9c5536ccf89310f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c5536ccf89310ec expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.614612:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636e00, rc 0) 00000100:00100000:0.0:1787862776.616079:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526462976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1530us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862776.616093:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787862776.617440:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526462976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787862776.617469:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.617481:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862776.617555:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526463104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.617615:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862776.618889:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787862776.620751:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463104 00000100:00100000:0.0:1787862776.620765:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463104 00000100:00100000:0.0:1787862776.621017:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787862776.621030:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526463104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.621560:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526463104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (3942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862776.621568:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787862776.623221:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526463104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.623285:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526463232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787862776.623406:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862776.623445:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787862776.625536:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463232 00000100:00100000:1.0:1787862776.625549:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463232 00000100:00100000:1.0:1787862776.625599:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787862776.625610:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526463232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787862776.625855:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:14311:x1874709526463232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862776.625863:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787862776.626337:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:14311:1874709526463232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787862776.633081:0:16503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787862776.633168:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787862776.633728:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787862776.634075:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862776.634090:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.160@tcp lock: ffff9a6534637800/0x9c5536ccf89310ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c5536ccf89310f3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862777.035504:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862777.035548:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862777.035573:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862777.035595:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862777.035612:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862777.035632:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862777.035662:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027328 00000100:00100000:2.0:1787862777.035673:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027328 00000100:00100000:2.0:1787862777.035734:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027584 00000100:00100000:2.0:1787862777.035737:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027584 00000100:00100000:2.0:1787862777.035749:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027200 00000100:00100000:2.0:1787862777.035751:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027200 00000100:00100000:2.0:1787862777.035764:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027712 00000100:00100000:2.0:1787862777.035766:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027712 00000100:00100000:2.0:1787862777.035782:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1787862777.035792:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517027328:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862777.035870:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517027328:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862777.035893:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1787862777.035912:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862777.035919:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2348:x1874709517027584:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862777.035947:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2348:x1874709517027584:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862777.035953:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862777.035964:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:2.0:1787862777.035970:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517027200:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862777.035991:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517027200:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862777.035998:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:2.0:1787862777.036008:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:2.0:1787862777.036014:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2348:x1874709517027712:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862777.036032:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2348:x1874709517027712:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 18us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862777.036037:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:2.0:1787862777.036086:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027072 00000100:00100000:2.0:1787862777.036090:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027072 00000100:00100000:2.0:1787862777.036114:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027456 00000100:00100000:2.0:1787862777.036117:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027456 00000100:00100000:2.0:1787862777.036136:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:2.0:1787862777.036142:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517027072:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862777.036168:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517027072:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862777.036180:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:2.0:1787862777.036192:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:2.0:1787862777.036198:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517027456:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862777.036220:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517027456:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862777.036225:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00080000:2.0:1787862777.036239:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862777.036243:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862777.036245:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862777.182626:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862778.012367:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526463744:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012450:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862778.012521:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787862778.012527:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526463360:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012560:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862778.012582:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526463872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012607:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862778.012631:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862778.012710:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526464000:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012732:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862778.012751:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862778.012756:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526463616:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012777:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862778.012807:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463744 00000100:00100000:1.0:1787862778.012815:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463744 00000100:00100000:1.0:1787862778.012862:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463872 00000100:00100000:1.0:1787862778.012866:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463872 00000100:00100000:1.0:1787862778.012889:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526464000 00000100:00100000:1.0:1787862778.012892:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526464000 00000100:00100000:1.0:1787862778.012906:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862778.012914:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526463744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.012964:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526463744:12345-0@lo:400:kworker.0 Request processed in 51us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862778.012971:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862778.012987:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787862778.012992:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526463872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013014:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650a17ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526463872:12345-0@lo:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862778.013019:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787862778.013029:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862778.013034:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013091:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526464000:12345-0@lo:400:kworker.0 Request processed in 57us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862778.013097:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862778.013119:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463360 00000100:00100000:1.0:1787862778.013121:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463360 00000100:00100000:1.0:1787862778.013141:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787862778.013146:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526463360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013174:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526463360:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862778.013180:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787862778.013207:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463488 00000100:00100000:1.0:1787862778.013211:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463488 00000100:00100000:1.0:1787862778.013235:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526463616 00000100:00100000:1.0:1787862778.013238:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526463616 00000100:00100000:1.0:1787862778.013251:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862778.013257:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526463488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013286:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526463488:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862778.013293:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787862778.013303:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787862778.013309:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526463616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013335:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526463616:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862778.013340:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787862778.013364:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862778.013367:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862778.013370:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862778.013400:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526463616:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013409:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013417:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526464000:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013448:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526463360:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013456:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526463872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862778.013463:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526463744:0@lo:400:kworker.0 00000100:00100000:2.0:1787862778.013874:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862778.013885:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526464128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862778.013919:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862778.013988:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526464128 00000100:00100000:3.0:1787862778.013993:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526464128 00000100:00100000:3.0:1787862778.014026:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787862778.014061:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526464128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862778.014093:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862778.014135:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526464128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862778.014141:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787862778.014172:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526464128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862778.205403:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862779.037700:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862779.037729:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526464256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862779.037820:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862779.037905:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526464256 00000100:00100000:2.0:1787862779.037912:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526464256 00000100:00100000:2.0:1787862779.037966:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787862779.037976:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526464256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862779.038014:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862779.038076:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526464256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862779.038084:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787862779.038363:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526464256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862779.228319:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862779.837808:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862779.837946:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517027840 00000100:00100000:1.0:1787862779.837960:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517027840 00000100:00100000:1.0:1787862779.838114:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787862779.838129:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:14403:x1874709517027840:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862779.838156:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862779.838189:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf89310fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b33 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838277:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838295:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838310:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838326:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838333:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838339:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838912:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf893110f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838923:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf893110f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.838931:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf893110f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862779.839021:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787862779.839026:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862779.839172:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf893110f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839187:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839195:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839203:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839210:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfdc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862779.839215:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839223:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839238:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:1.0:1787862779.839249:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862779.839256:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839263:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf8931101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839278:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839285:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839291:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839296:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862779.839299:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839305:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839313:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a65178bf500) 00010000:00010000:1.0:1787862779.839316:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862779.839320:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839325:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf8931108 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839363:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf89310fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b33 expref: 8 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839390:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfde00/0x9c5536ccf893110f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b33 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.839397:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a65178bfa00) 00010000:00010000:1.0:1787862779.839400:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862779.839402:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfde00, rc 0) 00000100:00100000:1.0:1787862779.839512:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:14403:x1874709517027840:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1387us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862779.839522:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00080000:2.0:1787862779.841077:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862779.843491:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862779.844765:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028096 00000100:00100000:1.0:1787862779.844786:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028096 00000100:00100000:1.0:1787862779.844888:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787862779.844906:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:14403:x1874709517028096:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862779.844939:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862779.844971:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931116 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b3a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.845111:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.845130:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.845145:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.853493:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.853534:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.853550:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.858270:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf893112b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.858295:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf893112b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.858308:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf893112b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862779.858323:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787862779.860127:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860146:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860154:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860161:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862779.860166:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860174:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860202:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a65178bfa00) 00010000:00010000:1.0:1787862779.860206:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862779.860211:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860219:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf893111d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860232:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860238:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860244:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860250:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfda00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862779.860253:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860259:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860265:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a65178bf500) 00010000:00010000:1.0:1787862779.860267:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862779.860269:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860274:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931124 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860736:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931116 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b3a expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860753:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd800/0x9c5536ccf893112b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b3a expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862779.860759:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a65178bf200) 00010000:00010000:1.0:1787862779.860761:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862779.860763:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd800, rc 0) 00000100:00100000:1.0:1787862779.860874:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14403:x1874709517028096:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 15973us (17414us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787862779.860884:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1787862779.889728:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862779.889820:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028224 00000100:00100000:1.0:1787862779.889842:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028224 00000100:00100000:1.0:1787862779.889913:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862779.889934:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14403:x1874709517028224:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787862779.890994:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14403:x1874709517028224:12345-192.168.202.60@tcp:59:lhsmtool_posix.0 Request processed in 1059us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862779.891421:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:2.0:1787862779.979323:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862779.979426:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028352 00000100:00100000:3.0:1787862779.979437:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028352 00000100:00100000:3.0:1787862779.979502:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862779.979513:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14409:x1874709517028352:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862779.979536:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862779.979561:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b41 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.979645:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.979670:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.979684:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.979699:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.979705:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.979729:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980000:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980439:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980446:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980452:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862779.980457:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980465:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980479:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:3.0:1787862779.980483:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862779.980487:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980492:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980501:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980505:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980515:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980518:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862779.980520:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980523:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980528:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6517c53000) 00010000:00010000:3.0:1787862779.980529:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862779.980531:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980534:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980561:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931139 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b41 expref: 10 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980568:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:3.0:1787862779.980570:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862779.980572:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b41 expref: 10 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.980577:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422dc00, rc 0) 00000100:00100000:3.0:1787862779.980706:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14409:x1874709517028352:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1195us (1393us total) trans 0 rc 301/301 00000100:00100000:3.0:1787862779.980722:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862779.988145:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862779.988344:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028480 00000100:00100000:2.0:1787862779.988357:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028480 00000100:00100000:2.0:1787862779.988420:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1787862779.988431:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14409:x1874709517028480:12345-192.168.202.60@tcp:700:lfs.0 00000100:00100000:2.0:1787862779.988527:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14409:x1874709517028480:12345-192.168.202.60@tcp:700:lfs.0 Request processed in 98us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862779.988536:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:0.0:1787862779.994198:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862779.994258:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028736 00000100:00100000:3.0:1787862779.994272:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028736 00000100:00100000:3.0:1787862779.994340:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1787862779.994358:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14409:x1874709517028736:12345-192.168.202.60@tcp:36:lfs.0 00010000:00010000:3.0:1787862779.994439:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862779.994470:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf893107c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34abc expref: 9 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.994493:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:3.0:1787862779.994506:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787862779.994827:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.994841:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 5 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.994851:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.994884:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 5 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862779.994897:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 5 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862779.994912:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526464384:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862779.995015:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787862780.000817:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.001037:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028864 00000100:00100000:2.0:1787862780.001182:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028864 00010000:00010000:2.0:1787862780.001236:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 6 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862780.001312:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:2.0:1787862780.001322:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517028864:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862780.001338:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862780.001345:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 6 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.001368:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 6 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.001392:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862780.001410:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.001420:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.001427:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.001447:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862780.001506:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517028864:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 176us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862780.001514:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00080000:3.0:1787862780.001565:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862780.001854:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89310b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b1e expref: 5 pid: 14315 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.001873:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526464384:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862780.001896:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.001907:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.001925:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.001949:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.001959:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.001968:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862780.003443:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787862780.003460:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.003470:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.003477:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.003483:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422dc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862780.003487:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.003495:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.003511:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:1.0:1787862780.003514:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862780.003527:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.003535:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893114e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862780.003555:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000489d41e1 reply state 00000000264a6057 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.003564:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862780.003664:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+10:14409:x1874709517028736:12345-192.168.202.60@tcp:36:lfs.0 Request processed in 9302us (9462us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787862780.003673:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00010000:00010000:2.0:1787862780.006301:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.006318:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.006326:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.006332:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862780.006336:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.006345:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.006371:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a65178bf500) 00010000:00010000:2.0:1787862780.006375:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862780.006393:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.006400:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf8931155 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862780.166089:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862780.166764:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517028992 00000100:00100000:1.0:1787862780.166777:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517028992 00000100:00100000:1.0:1787862780.166893:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:1.0:1787862780.166905:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:14417:x1874709517028992:12345-192.168.202.60@tcp:101:lctl.0 00010000:00010000:1.0:1787862780.166934:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862780.166959:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf893115c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b48 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.167033:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.167074:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.167087:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862780.167158:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787862780.167174:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862780.167219:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.167246:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf893115c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b48 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.167266:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfda00/0x9c5536ccf8931163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b48 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.167275:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:1.0:1787862780.167279:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862780.167283:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfda00, rc 0) 00000100:00100000:1.0:1787862780.167349:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+10:14417:x1874709517028992:12345-192.168.202.60@tcp:101:lctl.0 Request processed in 446us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862780.167362:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1787862780.193215:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.193320:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517029120 00000100:00100000:2.0:1787862780.193331:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517029120 00000100:00100000:2.0:1787862780.193625:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862780.193636:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:14418:x1874709517029120:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862780.193669:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862780.193694:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf893116a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b4f expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.193757:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf8931171 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.193772:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf8931171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.193784:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf8931171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862780.193845:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862780.193849:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862780.193876:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf8931171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.193902:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf893116a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b4f expref: 7 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.193921:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918800/0x9c5536ccf8931171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b4f expref: 6 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.193946:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787862780.193949:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862780.193954:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918800, rc 0) 00000100:00100000:2.0:1787862780.194179:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:14418:x1874709517029120:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 544us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862780.194187:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:0.0:1787862780.197606:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.197736:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517029248 00000100:00100000:3.0:1787862780.197746:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517029248 00000100:00100000:3.0:1787862780.197848:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:3.0:1787862780.197859:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:14418:x1874709517029248:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862780.197880:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862780.197900:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b56 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.197967:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.197981:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.197992:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198006:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198013:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198020:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198241:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893118d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198262:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893118d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198269:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893118d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862780.198309:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787862780.198312:0:15473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862780.198335:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893118d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198347:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198416:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198424:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198430:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862780.198435:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198443:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198455:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:3.0:1787862780.198459:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862780.198464:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198480:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf893117f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198561:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198569:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198575:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198581:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862780.198584:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198590:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198599:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6517c53000) 00010000:00010000:3.0:1787862780.198602:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862780.198605:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198610:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198640:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b56 expref: 8 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198683:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893118d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b56 expref: 7 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.198691:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6517c53900) 00010000:00010000:3.0:1787862780.198693:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862780.198696:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422dc00, rc 0) 00000100:00100000:3.0:1787862780.198768:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+7:14418:x1874709517029248:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 911us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862780.198775:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1787862780.203611:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.203778:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517029504 00000100:00100000:3.0:1787862780.203791:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517029504 00000100:00100000:3.0:1787862780.203970:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:3.0:1787862780.203982:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+7:14418:x1874709517029504:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862780.204003:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862780.204023:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b5d expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862780.204235:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787862780.204409:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b5d expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.204424:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:3.0:1787862780.204427:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862780.204432:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b5d expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.204463:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ce00, rc 0) 00000100:00100000:3.0:1787862780.204678:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+8:14418:x1874709517029504:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 697us (1076us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787862780.204686:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:2.0:1787862780.207311:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862780.207453:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517029760 00000100:00100000:1.0:1787862780.207464:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517029760 00000100:00100000:1.0:1787862780.207607:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:1.0:1787862780.207618:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+8:14418:x1874709517029760:12345-192.168.202.60@tcp:36:lfs.0 00010000:00010000:1.0:1787862780.207692:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862780.207716:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf893118d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b56 expref: 8 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.207734:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6517c53900) 00010000:00010000:1.0:1787862780.207744:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862780.207769:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.207797:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.207808:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862780.208021:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000480f2ba1 reply state 00000000fa90d0ed transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.208030:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787862780.208064:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787862780.208157:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+9:14418:x1874709517029760:12345-192.168.202.60@tcp:36:lfs.0 Request processed in 540us (853us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787862780.208164:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787862780.210720:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.211134:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517030016 00000100:00100000:3.0:1787862780.211144:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517030016 00000100:00100000:3.0:1787862780.211194:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1787862780.211204:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+9:14418:x1874709517030016:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862780.211450:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+10:14418:x1874709517030016:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 246us (738us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787862780.211457:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00010000:00010000:2.0:1787862780.212339:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.212362:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.212370:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.212377:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862780.212382:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.212390:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.212407:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf300) 00010000:00010000:2.0:1787862780.212410:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787862780.212415:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.212422:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc800/0x9c5536ccf89311a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862780.213623:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.213701:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517030272 00000100:00100000:2.0:1787862780.213711:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517030272 00000100:00100000:2.0:1787862780.213763:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:2.0:1787862780.213771:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+9:14418:x1874709517030272:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862780.213797:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862780.213817:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89311a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b64 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.213888:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.213902:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.213912:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.213926:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.213933:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.213939:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862780.214111:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787862780.214209:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214235:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214242:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214249:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862780.214253:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214261:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214272:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787862780.214275:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862780.214279:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214285:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214297:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214303:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214309:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214315:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862780.214322:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214329:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214336:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6507fe6900) 00010000:00010000:2.0:1787862780.214339:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862780.214341:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214358:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214397:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89311a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b64 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214407:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787862780.214409:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862780.214413:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89311a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b64 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.214423:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c919000, rc 0) 00000100:00100000:2.0:1787862780.214478:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+10:14418:x1874709517030272:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 708us (862us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787862780.214485:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1787862780.217726:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862780.217887:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517030400 00000100:00100000:1.0:1787862780.217897:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517030400 00000100:00100000:1.0:1787862780.217987:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1787862780.217997:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+10:14418:x1874709517030400:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862780.218023:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862780.218073:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89311c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b6b expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.218291:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.218306:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.218318:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862780.218392:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787862780.218396:0:15473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862780.218417:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.218447:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89311c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 12 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.218465:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 11 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.218475:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787862780.218478:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862780.218481:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfdc00, rc 0) 00000100:00100000:1.0:1787862780.218548:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+11:14418:x1874709517030400:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 553us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862780.218556:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:0.0:1787862780.222818:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.222926:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517030528 00000100:00100000:3.0:1787862780.222937:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517030528 00000100:00100000:3.0:1787862780.223029:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:3.0:1787862780.223076:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+11:14418:x1874709517030528:12345-192.168.202.60@tcp:37:lfs.0 00000100:00100000:3.0:1787862780.229826:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+11:14418:x1874709517030528:12345-192.168.202.60@tcp:37:lfs.0 Request processed in 6775us (7006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862780.229840:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:2.0:1787862780.238774:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862780.238876:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517030784 00000100:00100000:0.0:1787862780.238888:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517030784 00000100:00100000:0.0:1787862780.238981:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 4 00000100:00100000:0.0:1787862780.238993:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65098fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+11:14418:x1874709517030784:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862780.239286:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65098fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+12:14418:x1874709517030784:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 294us (522us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787862780.239294:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 4 00010000:00010000:2.0:1787862780.252183:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862780.307637:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.307775:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517030912 00000100:00100000:2.0:1787862780.307788:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517030912 00000100:00100000:2.0:1787862780.307871:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:2.0:1787862780.307881:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+10:14424:x1874709517030912:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862780.307903:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862780.307926:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89311d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b72 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.307991:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308007:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308019:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308033:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308040:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308235:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308348:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918200/0x9c5536ccf89311e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308357:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918200/0x9c5536ccf89311e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308364:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918200/0x9c5536ccf89311e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862780.308407:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787862780.308410:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862780.308450:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918200/0x9c5536ccf89311e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308463:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308470:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308478:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308485:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c918400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862780.308489:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308496:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308509:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787862780.308512:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862780.308517:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308524:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918400/0x9c5536ccf89311da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308537:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308552:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308559:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308563:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a651c919800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862780.308567:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308573:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308580:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6507fe6900) 00010000:00010000:2.0:1787862780.308583:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862780.308586:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308592:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919800/0x9c5536ccf89311e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308624:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c919000/0x9c5536ccf89311d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b72 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308637:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a651c918200/0x9c5536ccf89311e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b72 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.308644:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:2.0:1787862780.308646:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787862780.308666:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a651c918200, rc 0) 00000100:00100000:2.0:1787862780.308829:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+11:14424:x1874709517030912:12345-192.168.202.60@tcp:101:bash.0 Request processed in 948us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862780.308837:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:1.0:1787862780.311631:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.311730:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517031168 00000100:00100000:2.0:1787862780.311742:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517031168 00000100:00100000:2.0:1787862780.311838:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:2.0:1787862780.311848:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+11:14424:x1874709517031168:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862780.311869:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862780.311887:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf89311ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b79 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.312013:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.312028:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 11 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.312038:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.312095:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 11 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.312108:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 11 pid: 15473 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862780.312123:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526464512:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862780.312267:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d05240 going to sleep for 11 seconds 00000100:00100000:2.0:1787862780.315571:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.315841:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517031296 00000100:00100000:3.0:1787862780.315851:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517031296 00010000:00010000:3.0:1787862780.315895:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 12 pid: 15473 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862780.315937:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862780.315961:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+12:2349:x1874709517031296:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862780.315978:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862780.315985:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 12 pid: 15473 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.315998:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 12 pid: 15473 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.316020:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:3.0:1787862780.316025:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.316035:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.316075:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.316105:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862780.316158:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+12:2349:x1874709517031296:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 199us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862780.316166:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00010000:00010000:1.0:1787862780.319866:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfdc00/0x9c5536ccf89311cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b6b expref: 11 pid: 15473 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.319890:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526464512:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862780.319915:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.319954:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.319979:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.320005:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.320019:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.320029:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321269:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321285:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321294:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862780.321305:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787862780.321332:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321340:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321400:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321407:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862780.321417:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321426:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321440:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787862780.321443:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862780.321448:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321454:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89311f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787862780.321467:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da69e07 reply state 0000000032ce2910 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.321476:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787862780.321510:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf89311ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321525:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.321533:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:1.0:1787862780.321535:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787862780.321538:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc200, rc 0) 00000100:00100000:1.0:1787862780.321690:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14424:x1874709517031168:12345-192.168.202.60@tcp:101:bash.0 Request processed in 9842us (10067us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787862780.321699:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00010000:00010000:0.0:1787862780.323492:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.323510:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.323517:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.323524:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862780.323529:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.323537:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.323573:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a65178bfd00) 00010000:00010000:0.0:1787862780.323576:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862780.323581:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.323588:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89311fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862780.335546:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.335661:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517031424 00000100:00100000:3.0:1787862780.335886:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517031424 00000100:00100000:3.0:1787862780.335985:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:3.0:1787862780.335996:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+13:14424:x1874709517031424:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862780.336022:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862780.336145:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931212 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b80 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336231:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336247:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336260:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862780.336300:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862780.336304:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862780.336325:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336335:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336421:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931212 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 15 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336441:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.336450:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:3.0:1787862780.336453:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862780.336457:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:3.0:1787862780.336518:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14424:x1874709517031424:12345-192.168.202.60@tcp:101:bash.0 Request processed in 524us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862780.336527:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:0.0:1787862780.339886:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.339949:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517031680 00000100:00100000:3.0:1787862780.339959:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517031680 00000100:00100000:3.0:1787862780.340014:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:3.0:1787862780.340024:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14424:x1874709517031680:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:3.0:1787862780.340535:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:14424:x1874709517031680:12345-192.168.202.60@tcp:35:bash.0 Request processed in 511us (656us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787862780.340544:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 5 00000100:00100000:0.0:1787862780.404668:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862780.404806:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517031936 00000100:00100000:1.0:1787862780.404818:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517031936 00000100:00100000:1.0:1787862780.404884:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:1.0:1787862780.404894:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:14434:x1874709517031936:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862780.404920:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862780.404943:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b87 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862780.405102:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787862780.405214:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931220 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b87 expref: 17 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.405230:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:1.0:1787862780.405233:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862780.405239:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b87 expref: 17 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.405252:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00000100:00100000:1.0:1787862780.405300:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+16:14434:x1874709517031936:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 408us (657us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787862780.405308:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:1.0:1787862780.407581:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862780.407684:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517032192 00000100:00100000:0.0:1787862780.407693:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517032192 00000100:00100000:0.0:1787862780.407746:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787862780.407755:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+16:14434:x1874709517032192:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:0.0:1787862780.408010:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+17:14434:x1874709517032192:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 255us (442us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787862780.408018:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 6 00000100:00100000:0.0:1787862780.437386:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.440914:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517032448 00000100:00100000:2.0:1787862780.440929:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517032448 00000100:00100000:2.0:1787862780.441017:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:2.0:1787862780.441029:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+17:14437:x1874709517032448:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862780.441075:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862780.441107:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf893122e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b8e expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.441207:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931235 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.441223:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931235 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.441234:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931235 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862780.441244:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787862780.441367:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf893122e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b8e expref: 20 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.441387:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931235 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b8e expref: 19 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.441396:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:2.0:1787862780.441398:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787862780.441414:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16c00, rc 0) 00000100:00100000:2.0:1787862780.441738:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14437:x1874709517032448:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 711us (4361us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787862780.441748:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:2.0:1787862780.446318:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862780.446428:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517032576 00000100:00100000:1.0:1787862780.446436:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517032576 00000100:00100000:1.0:1787862780.446491:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:1.0:1787862780.446498:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14437:x1874709517032576:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:1.0:1787862780.446558:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446584:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446594:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446617:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446622:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446627:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446630:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862780.446634:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446639:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446657:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:1.0:1787862780.446660:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862780.446665:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.446678:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931243 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.446758:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14437:x1874709517032576:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 259us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862780.446772:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000040:00080000:2.0:1787862780.700781:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787862780.913285:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862780.913867:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517032832 00000100:00100000:3.0:1787862780.913882:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517032832 00000100:00100000:3.0:1787862780.914204:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862780.914216:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14474:x1874709517032832:12345-192.168.202.60@tcp:101:dd.0 00010000:00010000:3.0:1787862780.914241:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862780.914267:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf893124a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b95 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.914396:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.914412:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 20 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.914420:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 20 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.914429:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.914468:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 20 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862780.914632:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 20 pid: 14316 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862780.914665:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526464640:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862780.917842:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 20 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.917862:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 20 pid: 14315 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862780.917878:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534149e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526464768:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862780.917967:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862780.924135:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862780.924177:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.924232:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517032960 00000100:00100000:2.0:1787862780.924242:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517032960 00010000:00010000:2.0:1787862780.924298:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 21 pid: 14316 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862780.924332:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517033088 00000100:00100000:2.0:1787862780.924335:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517033088 00010000:00010000:2.0:1787862780.924346:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 22 pid: 14315 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862780.924359:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:2.0:1787862780.924368:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:2348:x1874709517032960:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862780.924384:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787862780.924388:0:14299:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787862780.924391:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 22 pid: 14316 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862780.924400:0:14299:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787862780.924410:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 22 pid: 14316 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.924433:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:2.0:1787862780.924439:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.924460:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.924467:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862780.924494:0:14300:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787862780.924519:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:0.0:1787862780.924528:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:2349:x1874709517033088:12345-192.168.202.60@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787862780.924535:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:2348:x1874709517032960:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 164us (411us total) trans 0 rc 0/0 00010000:00010000:0.0:1787862780.924539:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787862780.924545:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00010000:00010000:0.0:1787862780.924549:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 22 pid: 14315 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.924563:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 21 pid: 14315 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.924576:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:0.0:1787862780.925443:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.925455:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.925464:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862780.925488:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862780.925535:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+21:2349:x1874709517033088:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 1007us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862780.925543:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00010000:00010000:1.0:1787862780.925955:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931219 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b80 expref: 20 pid: 14316 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.925972:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526464640:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862780.925983:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf8931204 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b79 expref: 19 pid: 14315 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862780.925993:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534149e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526464768:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862780.926014:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.926024:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.926030:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862780.926640:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787862780.927498:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf893124a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 20 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.928409:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.928428:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:1.0:1787862780.928450:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862780.928457:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d200, rc 0) 00000100:00100000:1.0:1787862780.928554:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14474:x1874709517032832:12345-192.168.202.60@tcp:101:dd.0 Request processed in 14338us (15277us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787862780.928565:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862780.932997:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862780.933259:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517033344 00000100:00100000:2.0:1787862780.933270:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517033344 00000100:00100000:2.0:1787862780.933412:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:2.0:1787862780.933423:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14474:x1874709517033344:12345-192.168.202.60@tcp:36:dd.0 00010000:00010000:2.0:1787862780.933789:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.933811:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862780.933826:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862780.933885:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:2.0:1787862780.933913:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f77fc8a0 reply state 00000000c0c7e263 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862780.933925:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862780.934339:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:14474:x1874709517033344:12345-192.168.202.60@tcp:36:dd.0 Request processed in 915us (1353us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787862780.934354:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000020:00080000:2.0:1787862780.934361:0:14315:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787862780.943309:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.943330:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.943339:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.943355:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862780.943361:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.943369:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.943389:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:1.0:1787862780.943392:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862780.943398:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862780.943405:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf893125f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.276459:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862781.343153:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862781.343438:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517033472 00000100:00100000:0.0:1787862781.343449:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517033472 00000100:00100000:0.0:1787862781.343524:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1787862781.343549:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+21:14488:x1874709517033472:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:0.0:1787862781.343574:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862781.343596:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931266 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34b9c expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343676:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343691:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343702:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343715:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343721:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343728:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343818:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343829:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343838:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343879:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.343893:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 22 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862781.343906:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526464896:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862781.344005:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2c900 going to sleep for 11 seconds 00000100:00080000:3.0:1787862781.344650:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862781.347240:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862781.347313:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517033728 00000100:00100000:3.0:1787862781.347321:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517033728 00000100:00100000:3.0:1787862781.347385:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:3.0:1787862781.347395:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:13743:x1874709517033728:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787862781.347669:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:13743:x1874709517033728:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 274us (438us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787862781.347677:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 7 00000100:00100000:2.0:1787862781.348559:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526464896:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862781.348589:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862781.349990:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862781.350064:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517033856 00000100:00100000:2.0:1787862781.350073:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517033856 00010000:00010000:2.0:1787862781.350118:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 24 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862781.350156:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:2.0:1787862781.350165:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:2348:x1874709517033856:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862781.350179:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862781.350185:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 24 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.350199:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 24 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.350222:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931251 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b95 expref: 24 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.350239:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:2.0:1787862781.350244:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.350255:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.350263:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.350308:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862781.350367:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:2348:x1874709517033856:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 202us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862781.350374:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00010000:00010000:3.0:1787862781.350579:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350588:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862781.350635:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862781.350649:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862781.350686:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350707:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350718:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350725:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350732:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350738:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862781.350742:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350749:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350759:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:3.0:1787862781.350762:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862781.350766:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350772:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf893126d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350782:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350788:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350798:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350803:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862781.350806:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350812:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350820:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfc900) 00010000:00010000:3.0:1787862781.350822:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862781.350825:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350830:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931274 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350866:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931266 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b9c expref: 23 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350880:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b9c expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.350887:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:3.0:1787862781.350889:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862781.350891:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636600, rc 0) 00000100:00100000:3.0:1787862781.350931:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:14488:x1874709517033472:12345-192.168.202.60@tcp:101:stat.0 Request processed in 7385us (7791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862781.350947:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 35 00000100:00100000:0.0:1787862781.415997:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862781.416361:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517034112 00000100:00100000:1.0:1787862781.416372:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517034112 00000100:00100000:1.0:1787862781.416433:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:1.0:1787862781.416458:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:14494:x1874709517034112:12345-192.168.202.60@tcp:36:truncate.0 00010000:00010000:1.0:1787862781.416704:0:15473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862781.416733:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893127b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b9c expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.416753:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:1.0:1787862781.416758:0:15473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862781.416962:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.416976:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.416986:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862781.417030:0:15473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787862781.417239:0:15473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067408305 reply state 00000000433731f2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862781.417249:0:15473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862781.417470:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:14494:x1874709517034112:12345-192.168.202.60@tcp:36:truncate.0 Request processed in 1013us (1483us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787862781.417479:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000020:00080000:1.0:1787862781.418159:0:15473:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787862781.420085:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.420099:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.420108:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.420114:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862781.420119:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.420128:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.420146:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:0.0:1787862781.420149:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862781.420166:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.420172:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931282 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862781.708561:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862781.708688:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517034240 00000100:00100000:1.0:1787862781.708698:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517034240 00000100:00100000:1.0:1787862781.708773:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:1.0:1787862781.708784:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:14508:x1874709517034240:12345-192.168.202.60@tcp:101:stat.0 00010000:00010000:1.0:1787862781.708836:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862781.708858:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931289 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34ba3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.708934:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.708949:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.708962:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.708977:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.708985:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.708992:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709126:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709148:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709156:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862781.709196:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787862781.709208:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862781.709236:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709248:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709257:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709264:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709271:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709277:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862781.709282:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709289:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709301:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787862781.709304:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862781.709309:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709315:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931290 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709328:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709343:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709350:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709355:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862781.709357:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709363:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709370:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a65178bf400) 00010000:00010000:1.0:1787862781.709372:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862781.709375:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709380:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931297 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709410:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931289 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 25 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709422:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 24 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.709429:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:1.0:1787862781.709432:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862781.709438:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:1.0:1787862781.709502:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:14508:x1874709517034240:12345-192.168.202.60@tcp:101:stat.0 Request processed in 720us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862781.709510:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:1.0:1787862781.864586:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862781.864794:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517034496 00000100:00100000:2.0:1787862781.864811:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517034496 00000100:00100000:2.0:1787862781.864891:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:2.0:1787862781.864903:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:14518:x1874709517034496:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862781.864926:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862781.864952:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf89312a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34baa expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862781.865146:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787862781.865274:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf89312a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34baa expref: 26 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.865290:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787862781.865294:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862781.865299:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf89312a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34baa expref: 26 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.865316:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16400, rc 0) 00000100:00100000:2.0:1787862781.865397:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+25:14518:x1874709517034496:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 495us (826us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787862781.865406:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:0.0:1787862781.867453:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862781.867832:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517034752 00000100:00100000:3.0:1787862781.867848:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517034752 00000100:00100000:3.0:1787862781.867936:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:3.0:1787862781.867950:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+25:14518:x1874709517034752:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862781.868517:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:14518:x1874709517034752:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 567us (1078us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787862781.868527:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 8 00000100:00100000:0.0:1787862781.947781:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862781.949380:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517035008 00000100:00100000:1.0:1787862781.949401:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517035008 00000100:00100000:1.0:1787862781.949508:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787862781.949520:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:14524:x1874709517035008:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862781.949877:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862781.949908:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89312b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bb1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.950109:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.950127:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 27 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.950136:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.950183:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 27 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862781.950202:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 27 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862781.950221:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526465024:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862781.953074:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862781.962521:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862781.962741:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526465024:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862781.962793:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862781.964768:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517035136 00000100:00100000:3.0:1787862781.964785:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517035136 00010000:00010000:3.0:1787862781.964841:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 28 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862781.964894:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787862781.964907:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+28:2349:x1874709517035136:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862781.964926:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862781.964934:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 28 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.964952:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 28 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.964977:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf893129e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ba3 expref: 28 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.964998:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:3.0:1787862781.965018:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.965028:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.965036:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.965119:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862781.965199:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:2349:x1874709517035136:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 294us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862781.965209:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00010000:00010000:0.0:1787862781.968773:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.968798:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862781.968831:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787862781.969166:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89312b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 28 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.969196:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 27 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862781.969207:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:0.0:1787862781.969211:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862781.969215:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd200, rc 0) 00000100:00100000:0.0:1787862781.969348:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:14524:x1874709517035008:12345-192.168.202.60@tcp:101:bash.0 Request processed in 19829us (21586us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787862781.969380:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:1.0:1787862781.973717:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862781.973831:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517035392 00000100:00100000:3.0:1787862781.973850:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517035392 00000100:00100000:3.0:1787862781.974004:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 40 00000100:00100000:3.0:1787862781.974017:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:14524:x1874709517035392:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:3.0:1787862781.974453:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.974473:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.974485:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787862781.974538:0:15473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:3.0:1787862781.974563:0:15473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000889cf6c2 reply state 00000000cf9742a2 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862781.974572:0:15473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787862781.974769:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+30:14524:x1874709517035392:12345-192.168.202.60@tcp:36:bash.0 Request processed in 752us (1069us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787862781.974777:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 40 00000020:00080000:3.0:1787862781.974783:0:15473:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787862781.984122:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862781.984215:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517035520 00000100:00100000:3.0:1787862781.984226:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517035520 00000100:00100000:3.0:1787862781.984285:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:3.0:1787862781.984295:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+30:14524:x1874709517035520:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862781.984321:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862781.984348:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89312cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bb8 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984451:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984467:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984475:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984482:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 5/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984501:0:14314:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984524:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.984556:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862781.984570:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526465152:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862781.984671:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7a240 going to sleep for 11 seconds 00010000:00010000:2.0:1787862781.984803:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984818:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984826:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984832:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862781.984835:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984845:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984862:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:2.0:1787862781.984865:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862781.984868:0:3267:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984876:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.984881:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89312c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862781.992187:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526465152:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862781.992220:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862781.992372:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862781.992479:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517035648 00000100:00100000:2.0:1787862781.992486:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517035648 00010000:00010000:2.0:1787862781.992522:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862781.992560:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862781.992569:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:2348:x1874709517035648:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862781.992601:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862781.992607:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.992620:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.992656:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89312ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb1 expref: 31 pid: 14316 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.992802:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:2.0:1787862781.992809:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.992821:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.992829:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862781.992859:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862781.992916:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+30:2348:x1874709517035648:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 347us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862781.992925:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00010000:00010000:3.0:1787862781.992981:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.992988:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862781.993036:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862781.993067:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862781.993093:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.993126:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf89312cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb8 expref: 30 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.993142:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb8 expref: 29 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862781.993150:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:3.0:1787862781.993158:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862781.993161:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422da00, rc 0) 00000100:00100000:3.0:1787862781.993185:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+29:14524:x1874709517035520:12345-192.168.202.60@tcp:101:bash.0 Request processed in 8893us (9081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862781.993192:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:1.0:1787862781.998443:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862781.998520:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517035904 00000100:00100000:3.0:1787862781.998532:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517035904 00000100:00100000:3.0:1787862781.998804:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:3.0:1787862781.998816:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+29:14524:x1874709517035904:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:3.0:1787862781.999133:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+30:14524:x1874709517035904:12345-192.168.202.60@tcp:35:bash.0 Request processed in 319us (703us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787862781.999143:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 9 00000100:00100000:1.0:1787862782.082609:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862782.082840:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517036160 00000100:00100000:2.0:1787862782.082852:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517036160 00000100:00100000:2.0:1787862782.082928:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:2.0:1787862782.082939:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+30:14534:x1874709517036160:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862782.082989:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862782.083019:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf89312dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bbf expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862782.083234:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787862782.083369:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf89312dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bbf expref: 32 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862782.083386:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:2.0:1787862782.083390:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862782.083396:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf89312dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bbf expref: 32 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862782.083416:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16400, rc 0) 00000100:00100000:2.0:1787862782.083483:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14534:x1874709517036160:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 545us (886us total) trans 8589934617 rc 301/301 00000100:00100000:2.0:1787862782.083491:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:1.0:1787862782.093829:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.093971:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517036288 00000100:00100000:0.0:1787862782.093985:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517036288 00000100:00100000:0.0:1787862782.094148:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862782.094163:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14534:x1874709517036288:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:0.0:1787862782.094258:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094278:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094292:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094310:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094318:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094326:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094432:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094442:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094450:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862782.094511:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094580:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094588:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094596:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094602:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862782.094606:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094613:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094626:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862782.094630:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862782.094645:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094652:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89312eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094668:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094675:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094688:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094693:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862782.094696:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094702:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094711:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfcc00) 00010000:00010000:0.0:1787862782.094713:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862782.094716:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094722:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89312f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094737:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094744:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094749:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094755:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862782.094758:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094775:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094784:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:0.0:1787862782.094787:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862782.094790:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.094796:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf89312f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862782.094883:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14534:x1874709517036288:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 721us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862782.094892:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862782.098754:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.098866:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517036544 00000100:00100000:3.0:1787862782.098878:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517036544 00000100:00100000:3.0:1787862782.098974:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:3.0:1787862782.098986:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65098fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14534:x1874709517036544:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862782.099316:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65098fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+32:14534:x1874709517036544:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 332us (575us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1787862782.099325:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 10 00000100:00100000:1.0:1787862782.162568:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.162620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.162663:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.162708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.162726:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.162757:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517036800 00000100:00100000:1.0:1787862782.162768:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517036800 00000100:00100000:1.0:1787862782.162825:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517037312 00000100:00100000:1.0:1787862782.162828:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517037312 00000100:00100000:1.0:1787862782.162841:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517036928 00000100:00100000:1.0:1787862782.162843:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517036928 00000100:00100000:1.0:1787862782.162860:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:1.0:1787862782.162870:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2346:x1874709517036800:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862782.162951:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2346:x1874709517036800:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 82us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862782.162959:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:1.0:1787862782.162988:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:1.0:1787862782.162994:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2346:x1874709517037312:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862782.163020:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2346:x1874709517037312:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862782.163039:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:1.0:1787862782.163099:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787862782.163105:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2346:x1874709517036928:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862782.163137:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2346:x1874709517036928:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862782.163143:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00080000:1.0:1787862782.163163:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862782.163168:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862782.163199:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.163219:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517037184 00000100:00100000:1.0:1787862782.163222:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517037184 00000100:00100000:1.0:1787862782.163245:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787862782.163251:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2346:x1874709517037184:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862782.163274:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2346:x1874709517037184:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862782.163280:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00080000:1.0:1787862782.163292:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862782.164314:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517037056 00000100:00100000:3.0:1787862782.164324:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517037056 00000100:00100000:3.0:1787862782.164397:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862782.164407:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+11:2346:x1874709517037056:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862782.164481:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+11:2346:x1874709517037056:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 76us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.164489:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:0.0:1787862782.167784:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517036672 00000100:00100000:0.0:1787862782.167799:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517036672 00000100:00100000:0.0:1787862782.167870:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:0.0:1787862782.167878:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517036672:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862782.167945:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517036672:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 69us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862782.167950:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00080000:1.0:1787862782.169085:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862782.169825:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.173731:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517037568 00000100:00100000:3.0:1787862782.173747:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517037568 00000100:00100000:3.0:1787862782.173821:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:3.0:1787862782.173833:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+32:14537:x1874709517037568:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862782.173861:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862782.173883:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931300 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bc6 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.173970:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.173987:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.173999:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174016:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174024:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174031:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174184:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931315 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174194:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931315 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174222:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931315 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862782.174234:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787862782.174336:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174344:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174350:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174357:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.174361:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174369:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174382:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:3.0:1787862782.174385:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.174390:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174395:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931307 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174408:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174414:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174425:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174431:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.174434:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174440:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174448:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517c53000) 00010000:00010000:3.0:1787862782.174451:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.174453:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174458:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893130e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174502:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931300 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bc6 expref: 35 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174516:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931315 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bc6 expref: 34 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.174524:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:3.0:1787862782.174526:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787862782.174528:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ce00, rc 0) 00000100:00100000:3.0:1787862782.174608:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14537:x1874709517037568:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 777us (4794us total) trans 8589934619 rc 0/0 00000100:00100000:3.0:1787862782.174626:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 44 00000100:00100000:0.0:1787862782.197851:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.197909:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862782.198079:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517037952 00000100:00100000:2.0:1787862782.198090:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517037952 00000100:00100000:2.0:1787862782.198158:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1787862782.198170:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:2349:x1874709517037952:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862782.198187:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862782.198215:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf8931315 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bc6 expref: 34 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862782.198235:0:16549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:2.0:1787862782.198240:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862782.198319:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+33:2349:x1874709517037952:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 151us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862782.198327:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:3.0:1787862782.200021:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517037824 00000100:00100000:3.0:1787862782.200033:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517037824 00000100:00100000:3.0:1787862782.200135:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:3.0:1787862782.200146:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+33:14537:x1874709517037824:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862782.200491:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14537:x1874709517037824:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 344us (2650us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787862782.200498:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 11 00000100:00100000:0.0:1787862782.204648:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.204923:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517038080 00000100:00100000:3.0:1787862782.204937:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517038080 00000100:00100000:3.0:1787862782.205106:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:3.0:1787862782.205119:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14537:x1874709517038080:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:3.0:1787862782.205287:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205305:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205317:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205356:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205363:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205370:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205387:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.205392:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205399:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205413:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:3.0:1787862782.205416:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862782.205421:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.205427:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931323 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862782.205501:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14537:x1874709517038080:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 387us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.205507:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00010000:00010000:2.0:1787862782.302488:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862782.525739:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.525910:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517038208 00000100:00100000:0.0:1787862782.525921:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517038208 00000100:00100000:0.0:1787862782.526012:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:0.0:1787862782.526024:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14556:x1874709517038208:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862782.526091:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862782.526117:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf893132a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bcd expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.526200:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931331 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.526216:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931331 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.526228:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931331 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862782.526296:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787862782.526301:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862782.526466:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931331 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.526496:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf893132a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bcd expref: 36 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.526515:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931331 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bcd expref: 35 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.526524:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862782.526526:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787862782.526531:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637400, rc 0) 00000100:00100000:0.0:1787862782.526587:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14556:x1874709517038208:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 566us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862782.526602:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 46 00000100:00100000:1.0:1787862782.538174:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.538264:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517038592 00000100:00100000:3.0:1787862782.538275:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517038592 00000100:00100000:3.0:1787862782.538350:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:3.0:1787862782.538361:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14556:x1874709517038592:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862782.539544:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14556:x1874709517038592:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 392us (589us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787862782.539561:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 12 00000100:00100000:1.0:1787862782.548935:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.549123:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517038720 00000100:00100000:0.0:1787862782.549135:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517038720 00000100:00100000:0.0:1787862782.549260:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:0.0:1787862782.549271:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14556:x1874709517038720:12345-192.168.202.60@tcp:103:lfs.0 00010000:00010000:0.0:1787862782.549293:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787862782.549344:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89312d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bb8 expref: 36 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.549368:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931235 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34b8e expref: 35 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.549380:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a65178bfc00) 00010000:00010000:0.0:1787862782.549393:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862782.549454:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14556:x1874709517038720:12345-192.168.202.60@tcp:103:lfs.0 Request processed in 185us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862782.549462:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:1.0:1787862782.554145:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.554307:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517038848 00000100:00100000:3.0:1787862782.554336:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517038848 00000100:00100000:3.0:1787862782.554411:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:3.0:1787862782.554439:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14556:x1874709517038848:12345-192.168.202.60@tcp:58:lfs.0 00010000:00010000:3.0:1787862782.554556:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.554574:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.554588:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787862782.555721:0:14315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787862782.555893:0:14315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787862782.555973:0:14315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787862782.556140:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14556:x1874709517038848:12345-192.168.202.60@tcp:58:lfs.0 Request processed in 1697us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.556152:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:1.0:1787862782.600441:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.600541:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517038976 00000100:00100000:3.0:1787862782.600552:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517038976 00000100:00100000:3.0:1787862782.600638:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1787862782.600651:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14558:x1874709517038976:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862782.600680:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862782.600714:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893133f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bd4 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.600795:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.600811:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.600841:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.600858:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.600864:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.600870:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601011:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601019:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601026:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862782.601111:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862782.601116:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862782.601139:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601153:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601162:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601180:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601187:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601195:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.601200:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601208:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601222:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:3.0:1787862782.601225:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.601231:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601238:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931346 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601251:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601257:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601263:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601268:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.601277:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601284:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601293:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517c53700) 00010000:00010000:3.0:1787862782.601296:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.601299:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601305:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893134d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601336:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893133f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 36 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601350:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 35 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.601357:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:3.0:1787862782.601359:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787862782.601362:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422dc00, rc 0) 00000100:00100000:3.0:1787862782.601427:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14558:x1874709517038976:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 778us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.601434:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000040:00080000:2.0:1787862782.748347:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862782.748363:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862782.748448:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787862782.748458:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862782.748668:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14347:1874709526465280:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787862782.749344:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d05300 going to sleep for 11 seconds 00000100:00100000:1.0:1787862782.754830:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.755130:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517039104 00000100:00100000:3.0:1787862782.755143:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517039104 00000100:00100000:3.0:1787862782.755211:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:3.0:1787862782.755225:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517039104:12345-192.168.202.60@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787862782.755363:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517039104:12345-192.168.202.60@tcp:900:lhsmtool_posix.0 Request processed in 141us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.755372:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1787862782.760257:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14347:1874709526465280:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787862782.763599:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862782.764166:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517039232 00000100:00100000:2.0:1787862782.764180:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517039232 00000100:00100000:2.0:1787862782.764264:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:2.0:1787862782.764277:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14569:x1874709517039232:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862782.764333:0:14315:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862782.764487:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14569:x1874709517039232:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 211us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862782.764495:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 49 00000100:00100000:2.0:1787862782.768697:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.768824:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517039360 00000100:00100000:3.0:1787862782.768840:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517039360 00000100:00100000:3.0:1787862782.768935:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:3.0:1787862782.768948:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14569:x1874709517039360:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787862782.769088:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.769112:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.769128:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.770757:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.770782:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.770796:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.770830:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.770835:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.770909:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862782.771151:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787862782.771157:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862782.771178:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771193:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771201:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771208:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771216:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.771222:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771230:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771245:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a65178bf200) 00010000:00010000:3.0:1787862782.771248:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.771254:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771261:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf893135b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771288:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771293:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771299:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771304:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.771662:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771671:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771681:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a6517c53700) 00010000:00010000:3.0:1787862782.771683:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.771686:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771692:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931362 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771710:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771717:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771722:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771736:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862782.771740:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771746:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771754:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:3.0:1787862782.771757:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862782.771760:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.771765:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf8931369 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862782.771972:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14569:x1874709517039360:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 3022us (3299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.771984:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 50 00000100:00100000:3.0:1787862782.780137:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.780531:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517039616 00000100:00100000:1.0:1787862782.780561:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517039616 00000100:00100000:1.0:1787862782.780665:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:1.0:1787862782.780684:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14569:x1874709517039616:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862782.780716:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862782.780747:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931370 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bdb expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.780891:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.780910:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.780936:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862782.780951:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787862782.781119:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781128:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781134:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781141:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862782.781146:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781154:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781176:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:1.0:1787862782.781179:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862782.781185:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781192:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf8931377 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781241:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931370 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bdb expref: 37 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781252:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a65178bf200) 00010000:00010000:1.0:1787862782.781255:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862782.781259:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf8931370 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bdb expref: 37 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.781269:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:1.0:1787862782.781489:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517039616:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 813us (1370us total) trans 8589934622 rc 301/301 00000100:00100000:1.0:1787862782.781499:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:0.0:1787862782.791811:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862782.791971:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517039744 00000100:00100000:2.0:1787862782.791983:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517039744 00000100:00100000:2.0:1787862782.792075:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:2.0:1787862782.792086:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517039744:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787862782.792129:0:14316:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787862782.792251:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517039744:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 167us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862782.792272:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:3.0:1787862782.800720:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.803383:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517040000 00000100:00100000:0.0:1787862782.803406:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517040000 00000100:00100000:0.0:1787862782.803500:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:0.0:1787862782.803513:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517040000:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862782.803541:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862782.803545:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787862782.803578:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931331 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bcd expref: 36 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.803634:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862782.803642:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862782.803660:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931385 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34be2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787862782.811202:0:14315:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787862782.811219:0:14315:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787862782.811364:0:14315:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787862782.819023:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893138c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.819795:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893138c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.819816:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893138c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.822576:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931385 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be2 expref: 38 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.822621:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893138c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be2 expref: 37 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.822644:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517dfcc00) 00010000:00010000:0.0:1787862782.822648:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862782.822653:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637000, rc 0) 00000100:00100000:0.0:1787862782.822779:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+37:14569:x1874709517040000:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 19267us (22073us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787862782.822807:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:1.0:1787862782.833274:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.833592:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517040256 00000100:00100000:0.0:1787862782.833605:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517040256 00000100:00100000:0.0:1787862782.833708:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:0.0:1787862782.833720:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+37:14569:x1874709517040256:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787862782.833802:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862782.833837:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893138c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be2 expref: 37 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.833861:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517dfcc00) 00010000:00010000:0.0:1787862782.833878:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862782.833910:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.833993:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834008:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834026:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834034:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834081:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834209:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834218:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834226:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834233:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862782.834238:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834247:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834256:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862782.834259:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862782.834263:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834270:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf893139a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834279:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834286:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834293:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834305:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862782.834318:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834333:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834342:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xad5b1f45 (ffff9a6517dfc000) 00010000:00010000:0.0:1787862782.834345:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862782.834347:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.834353:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xad5b1f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862782.834466:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517040256:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 746us (1208us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787862782.834475:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 54 00000100:00100000:1.0:1787862782.844435:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.844655:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517040384 00000100:00100000:3.0:1787862782.844668:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517040384 00000100:00100000:3.0:1787862782.844750:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:3.0:1787862782.844761:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14569:x1874709517040384:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862782.844790:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862782.844822:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89313a8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34be9 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.844889:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.844905:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.844920:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.845035:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89313a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 38 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.845082:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 37 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.845100:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787862782.845104:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862782.845109:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:3.0:1787862782.845199:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+37:14569:x1874709517040384:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 439us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.845207:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 55 00000100:00100000:1.0:1787862782.853400:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.854737:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517040640 00000100:00100000:0.0:1787862782.854762:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517040640 00000100:00100000:0.0:1787862782.854861:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:0.0:1787862782.854875:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+37:14569:x1874709517040640:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787862782.855000:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.855024:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.855039:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862782.855709:0:14316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787862782.855724:0:14316:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 508619680497ns, next at 509619676921ns, rc = 0 00000004:00010000:0.0:1787862782.855868:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084d9fbec reply state 0000000019ec0324 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862782.855880:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862782.856033:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14569:x1874709517040640:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 1157us (2657us total) trans 8589934624 rc 0/0 00000100:00100000:0.0:1787862782.856071:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:0.0:1787862782.866024:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.866107:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517040768 00000100:00100000:0.0:1787862782.866120:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517040768 00000100:00100000:0.0:1787862782.866205:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:0.0:1787862782.866218:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14569:x1874709517040768:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787862782.866254:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862782.866283:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bf0 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.868124:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 40 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.868161:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 40 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862782.868306:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862782.868312:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862782.868318:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637400, rc 0) 00000100:00100000:2.0:1787862782.868432:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14569:x1874709517040768:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 2214us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862782.868443:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00010000:00010000:1.0:1787862782.881791:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.881820:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.881857:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.881864:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862782.881871:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.881880:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.881902:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862782.881905:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862782.881911:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.881918:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89313b6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862782.882569:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.884993:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517040896 00000100:00100000:1.0:1787862782.885027:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517040896 00000100:00100000:1.0:1787862782.885175:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:1.0:1787862782.885189:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2349:x1874709517040896:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787862782.885893:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517040896:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 701us (3325us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787862782.885904:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:3.0:1787862782.894833:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862782.895130:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517041152 00000100:00100000:0.0:1787862782.895144:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517041152 00000100:00100000:0.0:1787862782.895248:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:0.0:1787862782.895260:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14569:x1874709517041152:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787862782.895614:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14569:x1874709517041152:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 354us (798us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1787862782.895623:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 13 00000100:00100000:1.0:1787862782.898854:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.900734:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517041408 00000100:00100000:3.0:1787862782.900754:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517041408 00000100:00100000:3.0:1787862782.900836:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:3.0:1787862782.900849:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14569:x1874709517041408:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862782.901085:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14569:x1874709517041408:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 237us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.901093:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:1.0:1787862782.917634:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.919126:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517041536 00000100:00100000:3.0:1787862782.919147:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517041536 00000100:00100000:3.0:1787862782.919240:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1787862782.919253:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14569:x1874709517041536:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787862782.919283:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862782.919528:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89313c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bf7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.919661:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89313cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.919959:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89313cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.919979:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89313cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862782.920035:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787862782.921604:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89313cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.921677:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89313c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf7 expref: 42 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.921703:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89313cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf7 expref: 41 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.921742:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:3.0:1787862782.921745:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787862782.921750:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422d200, rc 0) 00000100:00100000:3.0:1787862782.921858:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14569:x1874709517041536:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 2606us (4243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.921869:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:3.0:1787862782.927896:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.935743:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517041664 00000100:00100000:1.0:1787862782.935794:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517041664 00000100:00100000:1.0:1787862782.935939:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787862782.935953:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517041664:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862782.935982:0:14998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862782.936029:0:14998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34bfe expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862782.936872:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909efe, blocks: 0x1 00010000:00010000:1.0:1787862782.936903:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1787862782.936909:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862782.936925:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 7 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.936950:0:14998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 7 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.936968:0:14998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc400, rc 0) 00000100:00100000:1.0:1787862782.937274:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517041664:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 1323us (9395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862782.937286:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787862782.949857:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.949945:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517041920 00000100:00100000:3.0:1787862782.949957:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517041920 00000100:00100000:3.0:1787862782.950075:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:3.0:1787862782.950090:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14569:x1874709517041920:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787862782.950245:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14569:x1874709517041920:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 158us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.950254:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 60 00000100:00100000:3.0:1787862782.957936:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862782.958106:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042048 00000100:00100000:1.0:1787862782.958119:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042048 00000100:00100000:1.0:1787862782.958199:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787862782.958212:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:14569:x1874709517042048:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862782.958239:0:15001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862782.958279:0:15001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c05 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.958339:0:15001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 8 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.958352:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862782.958359:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862782.958365:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.958412:0:15001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 8 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862782.958428:0:15001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 8 pid: 14998 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862782.958445:0:15001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15001:1874709526465408:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862782.958576:0:15001:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651c058300 going to sleep for 11 seconds 00000100:00100000:2.0:1787862782.975769:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862782.976382:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042176 00000100:00100000:3.0:1787862782.976397:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042176 00010000:00010000:3.0:1787862782.976460:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 9 pid: 14998 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862782.976516:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:3.0:1787862782.976527:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:2349:x1874709517042176:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862782.976548:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862782.976579:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 9 pid: 14998 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.976616:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 9 pid: 14998 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.976664:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862782.976679:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862782.976690:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 9 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.976701:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 9 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862782.976751:0:14299:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 9 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862782.976768:0:14299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e87c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14299:1874709526465536:192.168.202.60@tcp:105: 00000100:00100000:3.0:1787862782.976881:0:14299:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a65095a7e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787862782.986654:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c817270/0x9c5536ccf89313d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bfe expref: 9 pid: 14998 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862782.986689:0:15001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15001:1874709526465408:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862782.986734:0:15001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 8 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862782.986755:0:15001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc800, rc 0) 00000100:00100000:3.0:1787862782.987871:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:14569:x1874709517042048:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 29651us (29941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862782.987886:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787862782.988467:0:14299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e87c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14299:1874709526465536:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787862782.988492:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862782.988526:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2349:x1874709517042176:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 12000us (12774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862782.988537:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:0.0:1787862783.003391:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862783.005764:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042304 00000100:00100000:2.0:1787862783.005783:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042304 00002000:00100000:2.0:1787862783.005843:0:15004:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9a653414a580 x1874709517042304/t0(0) o4->7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp:144/0 lens 504/0 e 0 to 0 dl 1787862794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787862783.005857:0:15004:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a653414a580 with x1874709517042304 ext(0->8) 00002000:00010000:2.0:1787862783.005863:0:15004:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a653414a580 00000100:00100000:2.0:1787862783.005909:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 0 00000100:00100000:2.0:1787862783.005920:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2349:x1874709517042304:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787862783.011091:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653414a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:2349:x1874709517042304:12345-192.168.202.60@tcp:4:lhsmtool_posix.0 Request processed in 5158us (7697us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787862783.011110:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 0 00002000:00100000:2.0:1787862783.011124:0:15004:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9a653414a580 x1874709517042304/t8589934595(0) o4->7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp:144/0 lens 504/448 e 0 to 0 dl 1787862794 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787862783.011137:0:15004:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a653414a580 with x1874709517042304 ext(0->8) 00002000:00010000:2.0:1787862783.011145:0:15004:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a653414a580 00000100:00100000:2.0:1787862783.019307:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862783.019586:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042432 00000100:00100000:3.0:1787862783.019603:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042432 00000100:00100000:3.0:1787862783.019721:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:3.0:1787862783.019736:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14569:x1874709517042432:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1787862783.025451:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787862783.087134:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:1.0:1787862783.087164:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787862783.087209:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787862783.087583:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+13:14569:x1874709517042432:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 67841us (68275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862783.087598:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 61 00000100:00100000:1.0:1787862783.088109:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862783.088131:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526465664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787862783.088204:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862783.088258:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526465664 00000100:00100000:1.0:1787862783.088266:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526465664 00000100:00100000:1.0:1787862783.088371:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787862783.088383:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526465664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787862783.088574:0:14998:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787862783.088578:0:14998:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787862782 00002000:00010000:1.0:1787862783.088581:0:14998:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862783.088583:0:14998:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787862782 -> 1787862782 00002000:00010000:1.0:1787862783.088585:0:14998:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787862783.088618:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1874709526465664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (414us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787862783.088637:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1787862783.088687:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6518f0ad00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787862783.088692:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526465664:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787862783.088786:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862783.092505:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862783.096062:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042560 00000100:00100000:0.0:1787862783.096084:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042560 00000100:00100000:0.0:1787862783.096175:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:0.0:1787862783.096186:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:2349:x1874709517042560:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787862783.130155:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1787862783.130178:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1787862783.130184:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:0.0:1787862783.130466:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517042560:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 34271us (37966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862783.130482:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862783.133022:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862783.133290:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526465920:0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.133305:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526466176:0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.133478:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862783.133483:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862783.133541:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862783.133550:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526465792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862783.133580:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862783.133599:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526466304:0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.133686:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862783.133693:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fea83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526466048:0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.133720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862783.133856:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042816 00000100:00100000:0.0:1787862783.133866:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042816 00000100:00100000:1.0:1787862783.133878:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526465792 00000100:00100000:1.0:1787862783.133881:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526465792 00000100:00100000:0.0:1787862783.133917:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526466176 00000100:00100000:0.0:1787862783.133920:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526466176 00000100:00100000:1.0:1787862783.133921:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787862783.133930:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526465792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862783.133967:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526466048 00000100:00100000:0.0:1787862783.133970:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526466048 00000100:00100000:0.0:1787862783.133982:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787862783.133988:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526466176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.133992:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526465792:12345-0@lo:400:kworker.0 Request processed in 63us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862783.133999:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787862783.134025:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526466176:12345-0@lo:400:kworker.0 Request processed in 38us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862783.134032:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787862783.134091:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526466176:0@lo:400:kworker.0 00000100:00100000:0.0:1787862783.134091:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787862783.134097:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.134117:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526465920 00000100:00100000:1.0:1787862783.134121:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526465920 00000100:00100000:0.0:1787862783.134127:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526466048:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862783.134133:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862783.134148:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787862783.134148:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:1.0:1787862783.134154:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526465920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862783.134154:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+13:14569:x1874709517042816:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00000100:00100000:1.0:1787862783.134185:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526465920:12345-0@lo:400:kworker.0 Request processed in 31us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862783.134191:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787862783.134208:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787862783.134213:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fea83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526466048:0@lo:400:kworker.0 00010000:00010000:0.0:1787862783.134241:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89313cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf7 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.134258:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787862783.134261:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862783.134268:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862783.134278:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526465920:0@lo:400:kworker.0 00000100:00100000:1.0:1787862783.134291:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526465792:0@lo:400:kworker.0 00010000:00010000:0.0:1787862783.134304:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.134443:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.134457:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862783.134813:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a098e6da reply state 0000000054275918 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862783.134826:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862783.134933:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14569:x1874709517042816:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 777us (1925us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1787862783.134942:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:0.0:1787862783.134961:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526466304 00000100:00100000:0.0:1787862783.134965:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526466304 00000100:00100000:0.0:1787862783.134986:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787862783.134992:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862783.135036:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526466304:12345-0@lo:400:kworker.0 Request processed in 44us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862783.135159:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787862783.135214:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862783.135220:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862783.135596:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526466304:0@lo:400:kworker.0 00000100:00100000:3.0:1787862783.138022:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862783.138140:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526466432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862783.138262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862783.138767:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526466432 00000100:00100000:3.0:1787862783.138779:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526466432 00000100:00100000:2.0:1787862783.140415:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862783.140456:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787862783.140477:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526466432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862783.140535:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862783.140635:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526466432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862783.140644:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787862783.140767:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.140782:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.140791:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.140798:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862783.140805:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.140828:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.140850:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862783.140853:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862783.140860:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.140867:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862783.140896:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517042944 00000100:00100000:0.0:1787862783.140903:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517042944 00000100:00100000:0.0:1787862783.140957:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:0.0:1787862783.140966:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517042944:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787862783.141297:0:15001:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787862783.141301:0:15001:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787862782 -> 1787862781 00002000:00010000:0.0:1787862783.141304:0:15001:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787862780 00002000:00010000:0.0:1787862783.141307:0:15001:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787862782 -> 1787862781 00002000:00010000:0.0:1787862783.141309:0:15001:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787862783.141371:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517042944:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 406us (968us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787862783.141379:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1787862783.146269:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526466432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862783.165170:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862783.165233:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517043200 00000100:00100000:0.0:1787862783.165248:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517043200 00000100:00100000:0.0:1787862783.165343:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:0.0:1787862783.165356:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+13:14569:x1874709517043200:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787862783.165480:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.165503:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 13 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.165515:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.165566:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 13 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.165583:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 13 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862783.165600:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526466560:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862783.165734:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787862783.172657:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526466560:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862783.172719:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862783.176227:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862783.176391:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517043328 00000100:00100000:1.0:1787862783.176404:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517043328 00010000:00010000:1.0:1787862783.176459:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.176512:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862783.176524:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517043328:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862783.176543:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862783.176557:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.176574:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.176604:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf89313af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34be9 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.176619:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862783.176635:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.176647:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.176655:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.176839:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862783.176911:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+13:2349:x1874709517043328:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 388us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862783.176921:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00010000:00010000:2.0:1787862783.177135:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177146:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177182:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177198:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177205:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177212:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862783.177217:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177226:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177238:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:2.0:1787862783.177241:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787862783.177246:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.177254:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89313e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862783.177315:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+12:14569:x1874709517043200:12345-192.168.202.60@tcp:55:lhsmtool_posix.0 Request processed in 11963us (12164us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787862783.177325:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:0.0:1787862783.182019:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862783.182240:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517043456 00000100:00100000:3.0:1787862783.182257:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517043456 00000100:00100000:3.0:1787862783.182442:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1787862783.182457:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d3f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2347:x1874709517043456:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787862783.182533:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.182566:0:14998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 7 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.182578:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862783.182584:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862783.182590:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.182783:0:14998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 7 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.182804:0:14998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 7 pid: 15001 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862783.182827:0:14998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14998:1874709526466688:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862783.182944:0:14998:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862783.194873:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862783.194888:0:14998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14998:1874709526466688:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862783.194929:0:14998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862783.195153:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517043584 00000100:00100000:2.0:1787862783.195161:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517043584 00010000:00010000:2.0:1787862783.195203:0:16549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 8 pid: 15001 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862783.195245:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:2.0:1787862783.195614:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2348:x1874709517043584:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862783.195643:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862783.195675:0:16549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 8 pid: 15001 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.195688:0:16549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 8 pid: 15001 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.195714:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008979d094/0x9c5536ccf89313d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c05 expref: 8 pid: 15001 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.195730:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862783.195734:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862783.195740:0:16549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.195747:0:16549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.195780:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862783.195853:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517043584:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 242us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862783.195859:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00010000:00010000:1.0:1787862783.198132:0:14998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198156:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198235:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198242:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198249:0:14998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198253:0:14998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862783.198257:0:14998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198263:0:14998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198287:0:14998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.198294:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bceb8d62/0x9c5536ccf89313ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.198451:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d3f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517043456:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 15991us (16444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862783.198476:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:2.0:1787862783.201282:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862783.201338:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517043840 00000100:00100000:3.0:1787862783.201350:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517043840 00000100:00100000:3.0:1787862783.201421:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 64 00000100:00100000:3.0:1787862783.201433:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+12:14569:x1874709517043840:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787862783.201536:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201570:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201580:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201903:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201915:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 13 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201925:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201965:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 13 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.201983:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 13 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862783.202001:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526466816:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862783.202611:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787862783.204930:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e861c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526466816:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862783.204974:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862783.209464:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862783.209590:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517043968 00000100:00100000:1.0:1787862783.209603:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517043968 00010000:00010000:1.0:1787862783.209682:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.209728:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787862783.209739:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517043968:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862783.209757:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862783.209764:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.209781:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.209809:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf89313bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bf0 expref: 14 pid: 15473 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.209828:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:1.0:1787862783.209835:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.209846:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.209871:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.209919:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862783.209999:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+13:2348:x1874709517043968:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 262us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862783.210009:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00010000:00010000:0.0:1787862783.210179:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.210190:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862783.210500:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:0.0:1787862783.210837:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:0.0:1787862783.210882:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:0.0:1787862783.211009:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14315:1874709526466944:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787862783.212738:0:14315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862783.212878:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526466944 00000100:00100000:0.0:1787862783.212889:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526466944 00000100:00100000:0.0:1787862783.212960:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862783.212981:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14315:x1874709526466944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787862783.213235:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14315:x1874709526466944:12345-0@lo:1000:mdt00_001.0 Request processed in 263us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862783.213243:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787862783.213284:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d05a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787862783.213314:0:14315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:0.0:1787862783.213322:0:14315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6518f0ad00, transno 8589934596 00000100:00100000:0.0:1787862783.213341:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14315:1874709526466944:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787862783.214715:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:0.0:1787862783.214813:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14315:1874709526467072:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787862783.214881:0:14315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862783.214974:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6507d05600 going to sleep for 11 seconds 00000100:00100000:3.0:1787862783.214979:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526467072 00000100:00100000:3.0:1787862783.214992:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526467072 00000100:00100000:3.0:1787862783.215263:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787862783.215275:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534149680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14315:x1874709526467072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787862783.215603:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534149680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14315:x1874709526467072:12345-0@lo:1000:mdt00_001.0 Request processed in 331us (722us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787862783.215613:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787862783.215673:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14315:1874709526467072:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787862783.215719:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215730:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215738:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215744:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ce00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862783.215748:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215770:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215787:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6517c53700) 00010000:00010000:0.0:1787862783.215790:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862783.215795:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215801:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ce00/0x9c5536ccf89313fc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215842:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215849:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215855:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215859:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862783.215862:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215868:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215882:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:0.0:1787862783.215885:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862783.215889:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215904:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c400/0x9c5536ccf8931338 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.215990:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.216006:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.216017:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.216141:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862783.216164:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 16 pid: 14314 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862783.216181:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526467200:192.168.202.60@tcp:104: 00000100:00100000:0.0:1787862783.216497:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6510a2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787862783.219815:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862783.219918:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526467200:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862783.219960:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.219993:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517044096 00000100:00100000:1.0:1787862783.220002:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517044096 00010000:00010000:1.0:1787862783.220148:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 17 pid: 14314 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.220206:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:1.0:1787862783.220219:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+17:2348:x1874709517044096:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862783.220238:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862783.220245:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 17 pid: 14314 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220260:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 17 pid: 14314 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220287:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf8931354 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34bd4 expref: 17 pid: 14314 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220439:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:1.0:1787862783.220446:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220457:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220466:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220486:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862783.220584:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+16:2348:x1874709517044096:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 367us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862783.220592:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00010000:00010000:1.0:1787862783.220615:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220633:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220647:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220655:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220662:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220669:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636800 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862783.220688:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220697:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220706:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:1.0:1787862783.220709:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862783.220713:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220720:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf8931403 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220731:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220737:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220743:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220749:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862783.220752:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220758:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220765:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517c53000) 00010000:00010000:1.0:1787862783.220767:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787862783.220778:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862783.220784:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89313f5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862783.221053:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:14569:x1874709517043840:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 19622us (19791us total) trans 8589934631 rc 0/0 00000100:00100000:1.0:1787862783.221073:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 64 00000020:00080000:1.0:1787862783.221077:0:14315:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787862783.221304:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862783.221310:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862783.221358:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787862783.221364:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862783.223795:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862783.223939:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517044352 00000100:00100000:2.0:1787862783.223953:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517044352 00000100:00100000:2.0:1787862783.224282:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 14 00000100:00100000:2.0:1787862783.224311:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:14569:x1874709517044352:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787862783.225217:0:14318:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787862783.225338:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:2.0:1787862783.225399:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.225419:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.225432:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.225441:0:14318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.225448:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.225456:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.225480:0:14318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787862783.225594:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+17:14569:x1874709517044352:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 1284us (1818us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1787862783.225604:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 14 00000020:00080000:2.0:1787862783.225611:0:14318:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862783.226468:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862783.226481:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.226492:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17600 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862783.226497:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.226507:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.226524:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6507fe6900) 00010000:00010000:3.0:1787862783.226528:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862783.226533:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.226539:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893140a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.226563:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862783.226564:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862783.226566:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862783.324378:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862783.623214:0:16589:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862783.623227:0:16589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862783.623269:0:16589:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787862783.623275:0:16589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862783.906523:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862783.906612:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517044608 00000100:00100000:3.0:1787862783.906633:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517044608 00000100:00100000:3.0:1787862783.906717:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1787862783.906730:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+17:14579:x1874709517044608:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862783.906755:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862783.906777:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c0c expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787862783.907078:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787862783.907262:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931411 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c0c expref: 19 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.907291:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a65178bf600) 00010000:00010000:3.0:1787862783.907294:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787862783.907301:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c0c expref: 19 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862783.907314:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:3.0:1787862783.907374:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14579:x1874709517044608:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 646us (860us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1787862783.907382:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:0.0:1787862783.910438:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862783.910556:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517044736 00000100:00100000:2.0:1787862783.910566:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517044736 00000100:00100000:2.0:1787862783.910730:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:2.0:1787862783.910740:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14579:x1874709517044736:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:2.0:1787862783.910829:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.910847:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.910860:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.910878:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.910885:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.910892:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911500:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911511:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911518:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862783.911559:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911712:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911731:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911738:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911744:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862783.911749:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911757:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911771:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:2.0:1787862783.911774:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862783.911780:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911786:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf893141f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911799:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911804:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911811:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911816:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862783.911825:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911831:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911840:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6507fe6b00) 00010000:00010000:2.0:1787862783.911842:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862783.911845:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911851:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf8931426 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911866:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911872:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911878:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911883:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862783.911886:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911892:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911899:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862783.911902:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862783.911912:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862783.911918:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf893142d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862783.912326:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14579:x1874709517044736:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 1584us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862783.912335:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 66 00000100:00100000:3.0:1787862783.914144:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862783.914218:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517044992 00000100:00100000:2.0:1787862783.914230:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517044992 00000100:00100000:2.0:1787862783.914295:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:2.0:1787862783.914305:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14579:x1874709517044992:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787862783.915111:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14579:x1874709517044992:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 805us (971us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1787862783.915122:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 15 00000100:00100000:1.0:1787862784.063698:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862784.063805:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517045248 00000100:00100000:3.0:1787862784.063817:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517045248 00000100:00100000:3.0:1787862784.063890:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:3.0:1787862784.063902:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+19:14582:x1874709517045248:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862784.063931:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862784.063957:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931434 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c13 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.064107:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.064125:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.064155:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.064170:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.064177:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.064184:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.064917:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.064929:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.064938:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862784.064949:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1787862784.065096:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065103:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065120:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065126:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862784.065130:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065138:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065151:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:2.0:1787862784.065155:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862784.065159:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065166:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf893143b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065178:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065184:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065190:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065195:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422d200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862784.065198:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065215:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065236:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517c53f00) 00010000:00010000:2.0:1787862784.065239:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862784.065242:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065248:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf8931442 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065699:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf8931434 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 22 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065720:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 21 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.065729:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862784.065731:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862784.065734:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16a00, rc 0) 00000100:00100000:2.0:1787862784.065866:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+21:14582:x1874709517045248:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1966us (2180us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1787862784.065875:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:1.0:1787862784.083003:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.083646:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517045376 00000100:00100000:0.0:1787862784.083660:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517045376 00000100:00100000:0.0:1787862784.083755:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:0.0:1787862784.083767:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+21:14582:x1874709517045376:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:0.0:1787862784.083851:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083871:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083884:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083914:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083921:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083928:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083934:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.083939:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083947:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083959:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.083963:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787862784.083968:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.083996:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931457 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862784.084132:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+21:14582:x1874709517045376:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 367us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862784.084141:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:0.0:1787862784.097018:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.097181:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517045632 00000100:00100000:2.0:1787862784.097193:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517045632 00000100:00100000:2.0:1787862784.097265:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:2.0:1787862784.097277:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65098f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+21:14582:x1874709517045632:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:2.0:1787862784.097609:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65098f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:14582:x1874709517045632:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 332us (613us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1787862784.097628:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 16 00000100:00100000:1.0:1787862784.155125:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.155327:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517045888 00000100:00100000:2.0:1787862784.155338:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517045888 00000100:00100000:2.0:1787862784.155405:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:2.0:1787862784.155416:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:12106:x1874709517045888:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862784.155448:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862784.155471:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893145e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c1a expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.155582:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.155599:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 23 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.155609:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.155657:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 23 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.155680:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 23 pid: 15473 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862784.155697:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526467328:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862784.155818:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505685540 going to sleep for 11 seconds 00000100:00100000:3.0:1787862784.156957:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862784.156976:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526467456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862784.157038:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862784.157199:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526467456 00000100:00100000:2.0:1787862784.157206:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526467456 00000100:00100000:2.0:1787862784.157263:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787862784.157273:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526467456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862784.157293:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787862784.157357:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526467456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862784.157365:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787862784.157504:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526467456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862784.162606:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862784.163085:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517046016 00000100:00100000:3.0:1787862784.163096:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517046016 00010000:00010000:3.0:1787862784.163139:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 24 pid: 15473 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862784.163345:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526467328:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862784.163373:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862784.163527:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:3.0:1787862784.163539:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:2348:x1874709517046016:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862784.163557:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862784.163565:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 24 pid: 15473 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.163580:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 24 pid: 15473 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.163633:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16a00/0x9c5536ccf8931449 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c13 expref: 24 pid: 15473 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.163651:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:3.0:1787862784.163656:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.163667:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.163683:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862784.163713:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862784.163769:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:2348:x1874709517046016:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 232us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862784.163777:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00010000:00010000:2.0:1787862784.164605:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.164626:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862784.164648:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1787862784.164819:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17600/0x9c5536ccf893145e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 24 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.164837:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 23 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.164845:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862784.164849:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787862784.164861:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16e00, rc 0) 00000100:00100000:2.0:1787862784.164918:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:12106:x1874709517045888:12345-192.168.202.60@tcp:101:bash.0 Request processed in 9504us (9802us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1787862784.164927:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 69 00000100:00100000:1.0:1787862784.172955:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.173089:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517046272 00000100:00100000:0.0:1787862784.173102:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517046272 00000100:00100000:0.0:1787862784.173176:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:0.0:1787862784.173188:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:12106:x1874709517046272:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:0.0:1787862784.173508:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.173526:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.173539:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787862784.173596:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:0.0:1787862784.173655:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5374078 reply state 000000005241e884 transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862784.173665:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787862784.173716:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:0.0:1787862784.173836:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:12106:x1874709517046272:12345-192.168.202.60@tcp:36:bash.0 Request processed in 650us (893us total) trans 8589934641 rc 0/0 00000100:00100000:0.0:1787862784.173863:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 70 00000020:00080000:0.0:1787862784.173869:0:14315:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787862784.177392:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.177412:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.177420:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.177426:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.177433:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.177441:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.177461:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.177464:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.177469:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.177476:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931473 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862784.182561:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.182653:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517046400 00000100:00100000:0.0:1787862784.182665:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517046400 00000100:00100000:0.0:1787862784.182738:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:0.0:1787862784.182751:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:12106:x1874709517046400:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862784.182798:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862784.182822:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893147a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c21 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.182894:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893147a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c21 expref: 27 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.182912:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893147a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c21 expref: 27 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.182936:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.182939:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787862784.182944:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636600, rc 0) 00000100:00100000:0.0:1787862784.183026:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:12106:x1874709517046400:12345-192.168.202.60@tcp:101:bash.0 Request processed in 278us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862784.183034:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 71 00000100:00100000:1.0:1787862784.187332:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.187506:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517046528 00000100:00100000:2.0:1787862784.187517:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517046528 00000100:00100000:2.0:1787862784.187602:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:2.0:1787862784.187626:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:12106:x1874709517046528:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862784.187648:0:15000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862784.187674:0:15000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c28 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787862784.187706:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 9, mtime: 0x6a909efd, atime: 0x6a909efc, ctime: 0x6a909efd, blocks: 0xb 00010000:00010000:2.0:1787862784.187729:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787862784.187735:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862784.187743:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.187764:0:15000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.187778:0:15000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17600, rc 0) 00000100:00100000:2.0:1787862784.187847:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:12106:x1874709517046528:12345-192.168.202.60@tcp:101:bash.0 Request processed in 234us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862784.187855:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00080000:0.0:1787862784.188774:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862784.192583:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.192758:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517046656 00000100:00100000:2.0:1787862784.192781:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517046656 00002000:00010000:2.0:1787862784.192822:0:15006:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (0->18446744073709551615) 00002000:00100000:2.0:1787862784.192827:0:15006:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6537e86940 with x1874709517046656 ext(0->18446744073709551615) 00002000:00010000:2.0:1787862784.192840:0:15006:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6537e86940. 00000100:00100000:2.0:1787862784.192879:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 1 00000100:00100000:2.0:1787862784.192890:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2349:x1874709517046656:12345-192.168.202.60@tcp:10:bash.0 00002000:00010000:2.0:1787862784.193266:0:15006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787862784.193271:0:15006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787862781 -> 1787862784 00002000:00010000:2.0:1787862784.193273:0:15006:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787862780 -> 1787862780 00002000:00010000:2.0:1787862784.193276:0:15006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787862781 -> 1787862784 00002000:00010000:2.0:1787862784.193278:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787862784.193518:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2349:x1874709517046656:12345-192.168.202.60@tcp:10:bash.0 Request processed in 628us (943us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787862784.193528:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 1 00002000:00010000:2.0:1787862784.193532:0:15006:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (0->18446744073709551615) 00002000:00100000:2.0:1787862784.193535:0:15006:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6537e86940 with x1874709517046656 ext(0->18446744073709551615) 00002000:00010000:2.0:1787862784.193540:0:15006:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6537e86940. 00000040:00080000:3.0:1787862784.284506:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862784.284516:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862784.284554:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787862784.284561:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862784.337409:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.337747:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517046912 00000100:00100000:0.0:1787862784.337760:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517046912 00000100:00100000:0.0:1787862784.337831:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:0.0:1787862784.337841:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:14596:x1874709517046912:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862784.337864:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862784.337887:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931488 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c2f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.338236:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637c00/0x9c5536ccf893148f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.338264:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637c00/0x9c5536ccf893148f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.338280:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637c00/0x9c5536ccf893148f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862784.338294:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787862784.338502:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf8931488 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c2f expref: 30 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.338522:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637c00/0x9c5536ccf893148f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c2f expref: 29 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.338531:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862784.338533:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787862784.338537:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534637c00, rc 0) 00000100:00100000:0.0:1787862784.338606:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+29:14596:x1874709517046912:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 767us (1211us total) trans 8589934642 rc 0/0 00000100:00100000:0.0:1787862784.338626:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:1.0:1787862784.342829:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.342921:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517047040 00000100:00100000:0.0:1787862784.342932:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517047040 00000100:00100000:0.0:1787862784.343006:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:0.0:1787862784.343017:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+29:14596:x1874709517047040:12345-192.168.202.60@tcp:34:lfs.0 00010000:00010000:0.0:1787862784.343135:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343155:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343189:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343205:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343213:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343220:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343531:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343540:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343546:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862784.343589:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343602:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343608:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343635:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343651:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.343656:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.343664:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344204:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862784.344210:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.344216:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344224:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893149d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344239:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344245:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344252:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344257:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.344260:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344266:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344288:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfc600) 00010000:00010000:0.0:1787862784.344291:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.344295:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344301:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344383:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344391:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344396:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344401:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.344404:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344410:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344418:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.344420:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.344424:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.344429:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862784.344584:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+29:14596:x1874709517047040:12345-192.168.202.60@tcp:34:lfs.0 Request processed in 1565us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862784.344595:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00010000:00010000:3.0:1787862784.355089:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862784.448952:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.449086:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517047296 00000100:00100000:0.0:1787862784.449097:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517047296 00000100:00100000:0.0:1787862784.449161:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:0.0:1787862784.449172:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+29:14599:x1874709517047296:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862784.449196:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862784.449230:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c36 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449311:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449339:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449351:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449367:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449375:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449382:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449757:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89314c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449767:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89314c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449775:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89314c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862784.449787:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787862784.449884:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449892:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449898:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449904:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.449909:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449916:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449928:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862784.449932:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.449937:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449955:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449968:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449974:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449979:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449984:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.449987:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.449993:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.450001:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfc600) 00010000:00010000:0.0:1787862784.450003:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.450006:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.450012:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.450122:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637600/0x9c5536ccf89314b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c36 expref: 32 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.450149:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89314c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c36 expref: 31 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.450156:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.450159:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787862784.450161:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636c00, rc 0) 00000100:00100000:0.0:1787862784.450237:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14599:x1874709517047296:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1066us (1296us total) trans 8589934643 rc 0/0 00000100:00100000:0.0:1787862784.450245:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 74 00000100:00100000:3.0:1787862784.456244:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.456501:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517047424 00000100:00100000:2.0:1787862784.456512:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517047424 00000100:00100000:2.0:1787862784.456587:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 75 00000100:00100000:2.0:1787862784.456598:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14599:x1874709517047424:12345-192.168.202.60@tcp:54:lfs.0 00010000:00010000:2.0:1787862784.456682:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.456699:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 31 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.456728:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.456768:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 31 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.456783:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 31 pid: 14316 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862784.456798:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526467584:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862784.456890:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6505685300 going to sleep for 11 seconds 00000100:00100000:3.0:1787862784.463010:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.463153:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526467584:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862784.463187:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862784.470487:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517047680 00000100:00100000:0.0:1787862784.470505:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517047680 00000100:00100000:1.0:1787862784.470890:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862784.470903:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+32:13744:x1874709517047680:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787862784.471437:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+33:13744:x1874709517047680:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 534us (8434us total) trans 8589934644 rc 0/0 00000100:00100000:1.0:1787862784.471447:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 17 00000100:00100000:1.0:1787862784.482124:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.482261:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517047808 00000100:00100000:0.0:1787862784.482272:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517047808 00010000:00010000:0.0:1787862784.482324:0:16549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 33 pid: 14316 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862784.482365:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:0.0:1787862784.482377:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+33:2349:x1874709517047808:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862784.482398:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862784.482405:0:16549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 33 pid: 14316 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.482419:0:16549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 33 pid: 14316 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.482444:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16e00/0x9c5536ccf8931465 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c1a expref: 33 pid: 14316 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.482477:0:16549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.482483:0:16549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.482494:0:16549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.482502:0:16549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.482539:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862784.482604:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+32:2349:x1874709517047808:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 228us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862784.482623:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00010000:00010000:2.0:1787862784.482928:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.482937:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.482970:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.482978:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.482995:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.483009:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862784.483014:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.483022:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.483033:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:2.0:1787862784.483036:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787862784.483081:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.483089:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf89314d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862784.483146:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14599:x1874709517047424:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 26549us (26912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862784.483155:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 75 00000100:00100000:1.0:1787862784.486774:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862784.487718:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517048064 00000100:00100000:3.0:1787862784.487750:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517048064 00000100:00100000:3.0:1787862784.487819:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862784.487831:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+31:14599:x1874709517048064:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:3.0:1787862784.488144:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+32:14599:x1874709517048064:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 314us (1378us total) trans 8589934645 rc 0/0 00000100:00100000:3.0:1787862784.488153:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 18 00000100:00100000:3.0:1787862784.703298:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.703497:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517048320 00000100:00100000:0.0:1787862784.703508:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517048320 00000100:00100000:0.0:1787862784.703585:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:0.0:1787862784.703596:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+32:14610:x1874709517048320:12345-192.168.202.60@tcp:101:cat.0 00010000:00010000:0.0:1787862784.703632:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862784.703654:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c3d expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.703940:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.703956:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.703990:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704006:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704013:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704020:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704388:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf89314f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704398:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf89314f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704406:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf89314f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862784.704417:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1787862784.704511:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704519:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704526:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.704533:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.704544:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.705512:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.705533:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862784.705536:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.705542:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.705548:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf89314e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.705563:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.705569:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706220:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706226:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.706230:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706237:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706251:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfc600) 00010000:00010000:0.0:1787862784.706254:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.706271:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706278:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf89314ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706379:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c3d expref: 35 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706395:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf89314f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c3d expref: 34 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.706402:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.706405:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862784.706407:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636800, rc 0) 00000100:00100000:0.0:1787862784.706485:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14610:x1874709517048320:12345-192.168.202.60@tcp:101:cat.0 Request processed in 2890us (3195us total) trans 8589934646 rc 0/0 00000100:00100000:0.0:1787862784.706494:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:0.0:1787862784.714916:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862784.716807:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517048576 00000100:00100000:3.0:1787862784.716825:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517048576 00000100:00100000:3.0:1787862784.716902:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:3.0:1787862784.716914:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14610:x1874709517048576:12345-192.168.202.60@tcp:35:cat.0 00000100:00100000:3.0:1787862784.717221:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14610:x1874709517048576:12345-192.168.202.60@tcp:35:cat.0 Request processed in 308us (2312us total) trans 8589934647 rc 0/0 00000100:00100000:3.0:1787862784.717230:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 19 00000100:00100000:1.0:1787862784.765936:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.766162:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517048832 00000100:00100000:0.0:1787862784.766173:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517048832 00000100:00100000:0.0:1787862784.766239:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:0.0:1787862784.766251:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14612:x1874709517048832:12345-192.168.202.60@tcp:36:rm.0 00010000:00010000:0.0:1787862784.766324:0:15473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787862784.766358:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636800/0x9c5536ccf89314f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c3d expref: 35 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766380:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636c00/0x9c5536ccf89314c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c36 expref: 34 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766412:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636600/0x9c5536ccf893147a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c21 expref: 33 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766422:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6507fe6e00) 00010000:00010000:0.0:1787862784.766433:0:15473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787862784.766455:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766469:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766479:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766494:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766501:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766509:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766871:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766881:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.766888:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787862784.767704:0:15473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 64 off8408 00000004:00080000:0.0:1787862784.767715:0:15473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 510531672055ns, next at 511531669165ns, rc = 0 00010000:00010000:0.0:1787862784.767784:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767796:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767804:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767811:0:15473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767818:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767824:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767840:0:15473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787862784.767883:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767889:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767895:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767901:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.767911:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767919:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767930:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517dfc200) 00010000:00010000:0.0:1787862784.767934:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787862784.767938:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767944:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf893150d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767962:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767968:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767973:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767984:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862784.767988:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.767993:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.768001:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862784.768003:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862784.768013:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.768019:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf89314ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787862784.768029:0:15473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072840a0f reply state 00000000965e4902 transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862784.768038:0:15473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787862784.768153:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+34:14612:x1874709517048832:12345-192.168.202.60@tcp:36:rm.0 Request processed in 1902us (2224us total) trans 8589934648 rc 0/0 00000100:00100000:0.0:1787862784.768163:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00010000:00010000:1.0:1787862784.768634:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862784.768648:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.768655:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862784.768659:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.768666:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.768677:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6517dfc200) 00010000:00010000:1.0:1787862784.768679:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787862784.768683:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.768689:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931514 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.768706:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862784.768707:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862784.768709:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862784.777497:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.777517:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.777525:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.777533:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636a00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862784.777538:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.777768:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.777787:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfc600) 00010000:00010000:2.0:1787862784.777790:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862784.777795:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.777801:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931506 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862784.900036:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862784.900184:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517049088 00000100:00100000:2.0:1787862784.900195:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517049088 00000100:00100000:2.0:1787862784.900267:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:2.0:1787862784.900278:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+33:14618:x1874709517049088:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862784.900318:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862784.900342:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf893151b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c44 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.900487:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.900502:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.900515:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.900529:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.900550:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.900557:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901277:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901288:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901296:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862784.901314:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787862784.901343:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901350:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901357:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901363:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a17e00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862784.901368:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901376:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901403:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:2.0:1787862784.901406:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862784.901412:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901418:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf8931522 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862784.901432:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015de3a30 reply state 00000000d924a82b transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862784.901441:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787862784.901473:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf893151b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 36 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901488:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 35 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862784.901496:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862784.901498:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787862784.901501:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16c00, rc 0) 00000100:00100000:2.0:1787862784.901580:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14618:x1874709517049088:12345-192.168.202.60@tcp:101:bash.0 Request processed in 1304us (1554us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1787862784.901589:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00010000:00010000:1.0:1787862784.905205:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.905224:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.905232:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.905239:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862784.905258:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.905267:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.905283:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6507fe6000) 00010000:00010000:1.0:1787862784.905287:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862784.905291:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862784.905298:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf8931529 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862784.909781:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862784.910131:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517049216 00000100:00100000:0.0:1787862784.910142:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517049216 00000100:00100000:0.0:1787862784.910213:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:0.0:1787862784.910224:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+35:14618:x1874709517049216:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:0.0:1787862784.910250:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862784.910273:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893153e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c4b expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910358:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910385:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910396:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862784.910440:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787862784.910462:0:15473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862784.910487:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910500:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910525:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf893153e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 37 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910545:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 36 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862784.910563:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862784.910566:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862784.910571:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636000, rc 0) 00000100:00100000:0.0:1787862784.910654:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14618:x1874709517049216:12345-192.168.202.60@tcp:101:bash.0 Request processed in 432us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862784.910662:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:0.0:1787862784.919875:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862784.920083:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517049472 00000100:00100000:3.0:1787862784.920094:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517049472 00000100:00100000:3.0:1787862784.920156:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1787862784.920167:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+36:14618:x1874709517049472:12345-192.168.202.60@tcp:35:bash.0 00000100:00100000:3.0:1787862784.920546:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+37:14618:x1874709517049472:12345-192.168.202.60@tcp:35:bash.0 Request processed in 380us (682us total) trans 8589934650 rc 0/0 00000100:00100000:3.0:1787862784.921724:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 20 00000100:00100000:3.0:1787862785.111519:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.111834:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517049728 00000100:00100000:2.0:1787862785.111845:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517049728 00000100:00100000:2.0:1787862785.111942:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00100000:2.0:1787862785.111953:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+37:14631:x1874709517049728:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862785.111992:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862785.112015:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf893154c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c52 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.112170:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf8931553 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.112184:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf8931553 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.112196:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf8931553 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862785.112206:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787862785.112334:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17e00/0x9c5536ccf893154c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c52 expref: 40 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.112352:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf8931553 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c52 expref: 39 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.112361:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862785.112364:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862785.112367:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16800, rc 0) 00000100:00100000:2.0:1787862785.112425:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14631:x1874709517049728:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 475us (918us total) trans 8589934651 rc 0/0 00000100:00100000:2.0:1787862785.112432:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 80 00000100:00080000:0.0:1787862785.113593:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862785.120883:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.120933:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.120996:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517049984 00000100:00100000:1.0:1787862785.121008:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517049984 00000100:00100000:0.0:1787862785.121010:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517049856 00000100:00100000:0.0:1787862785.121013:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517049856 00000100:00100000:1.0:1787862785.121082:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:1.0:1787862785.121092:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14631:x1874709517049984:12345-192.168.202.60@tcp:54:lfs.0 00000100:00100000:0.0:1787862785.121105:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:0.0:1787862785.121112:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:2348:x1874709517049856:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862785.121126:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862785.121152:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16800/0x9c5536ccf8931553 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c52 expref: 40 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121156:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121170:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121183:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.121189:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862785.121194:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862785.121209:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121215:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121227:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121232:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.121236:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.121241:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:2348:x1874709517049856:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 130us (370us total) trans 0 rc 0/0 00010000:00010000:1.0:1787862785.121244:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.121248:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00010000:00010000:1.0:1787862785.121252:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862785.121255:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862785.121259:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.121265:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931561 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.121301:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+38:14631:x1874709517049984:12345-192.168.202.60@tcp:54:lfs.0 Request processed in 211us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.121320:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 81 00000100:00100000:3.0:1787862785.124035:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.124130:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517050240 00000100:00100000:1.0:1787862785.124142:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517050240 00000100:00100000:1.0:1787862785.124201:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:1.0:1787862785.124211:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+38:14631:x1874709517050240:12345-192.168.202.60@tcp:35:lfs.0 00000100:00100000:1.0:1787862785.124488:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14631:x1874709517050240:12345-192.168.202.60@tcp:35:lfs.0 Request processed in 278us (473us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1787862785.124496:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 21 00000100:00100000:3.0:1787862785.221685:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.221750:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517050496 00000100:00100000:1.0:1787862785.221761:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517050496 00000100:00100000:1.0:1787862785.221830:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:1.0:1787862785.221842:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14641:x1874709517050496:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862785.221868:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862785.221890:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931568 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c59 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.221996:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.222013:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 40 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.222022:0:14315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 40 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.222031:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.222112:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 40 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.222129:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 40 pid: 15473 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.222144:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526467712:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862785.222249:0:14315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 40 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.222272:0:14315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 40 pid: 14314 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.222281:0:14315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526467840:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862785.222306:0:14315:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862785.225199:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526467712:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862785.225217:0:14315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14315:1874709526467840:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862785.225244:0:14315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862785.226337:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.226423:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862785.226522:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517050624 00000100:00100000:0.0:1787862785.226531:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517050624 00010000:00010000:0.0:1787862785.226583:0:16549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 41 pid: 15473 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.226623:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517050752 00000100:00100000:0.0:1787862785.226626:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517050752 00010000:00010000:0.0:1787862785.226637:0:16549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 42 pid: 14314 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.226666:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862785.226675:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:2348:x1874709517050624:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862785.226690:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862785.226696:0:16549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 42 pid: 15473 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226710:0:16549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 42 pid: 15473 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226733:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931545 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c4b expref: 42 pid: 15473 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226760:0:16549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862785.226765:0:16549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226774:0:16549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226781:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862785.226832:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:2348:x1874709517050624:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 158us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862785.226839:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862785.226857:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:0.0:1787862785.226863:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:2348:x1874709517050752:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862785.226869:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862785.226874:0:16549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 40 pid: 14314 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226884:0:16549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 40 pid: 14314 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226912:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf8931530 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c44 expref: 40 pid: 14314 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226922:0:16549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:0.0:1787862785.226926:0:16549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226943:0:16549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226950:0:16549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.226969:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862785.226986:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:2348:x1874709517050752:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 124us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862785.226993:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00010000:00010000:1.0:1787862785.227413:0:14315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.227422:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862785.227440:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787862785.227590:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf8931568 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 40 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.227613:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 39 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.227622:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862785.227624:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862785.227627:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfca00, rc 0) 00000100:00100000:1.0:1787862785.227672:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14641:x1874709517050496:12345-192.168.202.60@tcp:101:bash.0 Request processed in 5833us (5998us total) trans 8589934653 rc 0/0 00000100:00100000:1.0:1787862785.227679:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:3.0:1787862785.232345:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.232466:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051008 00000100:00100000:1.0:1787862785.232477:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051008 00000100:00100000:1.0:1787862785.232557:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:1.0:1787862785.232575:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+39:14641:x1874709517051008:12345-192.168.202.60@tcp:36:bash.0 00010000:00010000:1.0:1787862785.232878:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.232897:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.232910:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787862785.232966:0:15473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934654 00000004:00010000:1.0:1787862785.232992:0:15473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bb8b892 reply state 000000003908752d transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.233003:0:15473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862785.233139:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14641:x1874709517051008:12345-192.168.202.60@tcp:36:bash.0 Request processed in 572us (804us total) trans 8589934655 rc 0/0 00000100:00100000:1.0:1787862785.233148:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00000020:00080000:1.0:1787862785.233153:0:15473:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862785.234981:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.234998:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.235005:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.235012:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862785.235017:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.235024:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.235071:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:3.0:1787862785.235075:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862785.235081:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.235089:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc400/0x9c5536ccf893157d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.237239:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.237335:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051136 00000100:00100000:2.0:1787862785.237376:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051136 00000100:00100000:2.0:1787862785.237443:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:2.0:1787862785.237454:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14641:x1874709517051136:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:2.0:1787862785.237479:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862785.237501:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931584 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c60 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.237588:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931584 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c60 expref: 42 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.237619:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931584 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c60 expref: 42 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.237642:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862785.237647:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862785.237651:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17800, rc 0) 00000100:00100000:2.0:1787862785.237718:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14641:x1874709517051136:12345-192.168.202.60@tcp:101:bash.0 Request processed in 265us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.237725:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 84 00000100:00100000:2.0:1787862785.244874:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.246479:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051264 00000100:00100000:1.0:1787862785.246493:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051264 00000100:00100000:1.0:1787862785.246580:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:1.0:1787862785.246592:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14641:x1874709517051264:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862785.246642:0:15473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862785.246665:0:15473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893158b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c67 expref: -99 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.246754:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.246769:0:15473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 43 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.246779:0:15473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.246817:0:15473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 43 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.246832:0:15473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 43 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.246847:0:15473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15473:1874709526467968:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862785.246948:0:15473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6402fd6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787862785.249882:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.250135:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051392 00000100:00100000:2.0:1787862785.250146:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051392 00010000:00010000:2.0:1787862785.250187:0:16549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 44 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.250225:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:2.0:1787862785.250236:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+44:2349:x1874709517051392:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862785.250268:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862785.250275:0:16549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 44 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.250289:0:16549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 44 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.250327:0:16549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:2.0:1787862785.250332:0:16549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.250343:0:16549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.250352:0:16549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.250372:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862785.250432:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+44:2349:x1874709517051392:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 198us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.250441:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00010000:00010000:1.0:1787862785.250828:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf893156f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c59 expref: 43 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.250848:0:15473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15473:1874709526467968:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862785.250870:0:15473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.250892:0:15473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.250897:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862785.250945:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787862785.250950:0:15473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862785.250971:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.251003:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf893158b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c67 expref: 43 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.251017:0:15473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c67 expref: 42 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.251322:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862785.251327:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862785.251330:0:15473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfc600, rc 0) 00000100:00100000:1.0:1787862785.251367:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14641:x1874709517051264:12345-192.168.202.60@tcp:101:bash.0 Request processed in 4777us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.251375:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:0.0:1787862785.259481:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.259779:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051648 00000100:00100000:1.0:1787862785.259790:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051648 00000100:00100000:1.0:1787862785.259862:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:1.0:1787862785.259872:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14641:x1874709517051648:12345-192.168.202.60@tcp:103:bash.0 00010000:00010000:1.0:1787862785.259888:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787862785.259929:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf8931592 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c67 expref: 42 pid: 15473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.259952:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931584 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c60 expref: 41 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.259964:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6800) 00010000:00010000:1.0:1787862785.259975:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862785.260091:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14641:x1874709517051648:12345-192.168.202.60@tcp:103:bash.0 Request processed in 172us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.260099:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 3 00000100:00100000:0.0:1787862785.261974:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.262075:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051776 00000100:00100000:2.0:1787862785.262085:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051776 00000100:00100000:2.0:1787862785.262139:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:2.0:1787862785.262149:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14641:x1874709517051776:12345-192.168.202.60@tcp:58:bash.0 00010000:00010000:2.0:1787862785.262253:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.262271:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.262296:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787862785.262664:0:14314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:2.0:1787862785.262823:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14641:x1874709517051776:12345-192.168.202.60@tcp:58:bash.0 Request processed in 674us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.262832:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 86 00000100:00100000:2.0:1787862785.276933:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.277032:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517051904 00000100:00100000:1.0:1787862785.277071:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517051904 00000100:00100000:1.0:1787862785.277201:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:1.0:1787862785.277212:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+40:14641:x1874709517051904:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:1.0:1787862785.277237:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862785.277259:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c6e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.277329:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.277340:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 41 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.277360:0:14316:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.277376:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 41 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.277406:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787862785.277409:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787862785.277414:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 41 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.277422:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd200, rc 0) 00000100:00100000:1.0:1787862785.277485:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14641:x1874709517051904:12345-192.168.202.60@tcp:101:bash.0 Request processed in 275us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.277497:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000040:00080000:3.0:1787862785.308837:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862785.309198:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862785.309249:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787862785.309255:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862785.309407:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031de580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14347:1874709526468096:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787862785.309491:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787862785.322310:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.322512:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517052032 00000100:00100000:1.0:1787862785.322522:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517052032 00000100:00100000:1.0:1787862785.322615:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:1.0:1787862785.322626:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14642:x1874709517052032:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862785.322662:0:14314:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862785.322780:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14642:x1874709517052032:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 155us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.322788:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:3.0:1787862785.322807:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031de580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14347:1874709526468096:192.168.202.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787862785.329958:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.331502:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517052160 00000100:00100000:1.0:1787862785.331517:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517052160 00000100:00100000:1.0:1787862785.331615:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:1.0:1787862785.331628:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14642:x1874709517052160:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.331726:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.331743:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.331769:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.331785:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.331805:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.331811:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.331837:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332411:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332425:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862785.332474:0:15473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787862785.332480:0:15473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787862785.332494:0:15473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332506:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332513:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332534:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332540:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfc600 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.332545:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332553:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332566:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a65178bf200) 00010000:00010000:1.0:1787862785.332569:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862785.332574:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332580:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc600/0x9c5536ccf89315a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332597:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332617:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332623:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332628:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.332631:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332647:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332681:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9a65178bf400) 00010000:00010000:1.0:1787862785.332690:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862785.332694:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332700:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332723:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332729:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332735:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332740:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.332743:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332749:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332757:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787862785.332760:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862785.332763:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.332780:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.334560:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14642:x1874709517052160:12345-192.168.202.60@tcp:34:lhsmtool_posix.0 Request processed in 2924us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.334575:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 89 00000100:00100000:0.0:1787862785.350029:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.350234:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517052416 00000100:00100000:1.0:1787862785.350246:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517052416 00000100:00100000:1.0:1787862785.350310:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:1.0:1787862785.350322:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+41:14642:x1874709517052416:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.350346:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862785.350367:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89315bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c75 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350494:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350511:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350524:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862785.350536:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787862785.350658:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350666:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350694:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350700:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.350704:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350713:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350727:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787862785.350730:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787862785.350735:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350742:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350800:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89315bc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c75 expref: 43 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350811:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a65178bf200) 00010000:00010000:1.0:1787862785.350813:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787862785.350817:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89315bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c75 expref: 43 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.350827:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfce00, rc 0) 00000100:00100000:1.0:1787862785.350896:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14642:x1874709517052416:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 576us (878us total) trans 8589934656 rc 301/301 00000100:00100000:1.0:1787862785.350912:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 90 00000100:00100000:0.0:1787862785.363964:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.364227:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517052544 00000100:00100000:1.0:1787862785.364239:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517052544 00000100:00100000:1.0:1787862785.364304:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:1.0:1787862785.364314:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14642:x1874709517052544:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787862785.364351:0:15473:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787862785.364496:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14642:x1874709517052544:12345-192.168.202.60@tcp:53:lhsmtool_posix.0 Request processed in 182us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.364503:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:0.0:1787862785.375237:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.375335:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517052800 00000100:00100000:1.0:1787862785.375346:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517052800 00000100:00100000:1.0:1787862785.375408:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:1.0:1787862785.375418:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+42:14642:x1874709517052800:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.375442:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862785.375465:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89315d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c7c expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787862785.376320:0:14314:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1787862785.376329:0:14314:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787862785.376384:0:14314:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787862785.376614:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.376632:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.376645:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.376724:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfce00/0x9c5536ccf89315d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c7c expref: 45 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.376743:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c7c expref: 44 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.376752:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a65178bf400) 00010000:00010000:1.0:1787862785.376756:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787862785.376760:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfcc00, rc 0) 00010000:00010000:3.0:1787862785.377071:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862785.380169:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+44:14642:x1874709517052800:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 4739us (4931us total) trans 8589934657 rc 0/0 00000100:00100000:1.0:1787862785.380184:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:0.0:1787862785.388458:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.388541:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517053056 00000100:00100000:1.0:1787862785.388551:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517053056 00000100:00100000:1.0:1787862785.388623:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:1.0:1787862785.388634:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+44:14642:x1874709517053056:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.388704:0:15473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862785.388736:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf89315d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c7c expref: 44 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388756:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a65178bf400) 00010000:00010000:1.0:1787862785.388768:0:15473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787862785.388800:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388817:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388854:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388872:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388880:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388886:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388965:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388973:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388980:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.388987:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfd400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.388991:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389000:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389009:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:1.0:1787862785.389012:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862785.389016:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389028:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd400/0x9c5536ccf89315e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389039:0:15473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389071:0:15473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389077:0:15473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389093:0:15473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.389097:0:15473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389104:0:15473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389113:0:15473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3bea8a96 (ffff9a65178bf000) 00010000:00010000:1.0:1787862785.389116:0:15473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787862785.389118:0:15473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.389124:0:15473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf89315ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3bea8a96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.389220:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+43:14642:x1874709517053056:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 587us (772us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787862785.389229:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:0.0:1787862785.395618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.395716:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517053184 00000100:00100000:2.0:1787862785.395727:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517053184 00000100:00100000:2.0:1787862785.395802:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:2.0:1787862785.395813:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+43:14642:x1874709517053184:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862785.395836:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862785.395860:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89315f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c83 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.395897:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16600/0x9c5536ccf89315fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.395911:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16600/0x9c5536ccf89315fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.395924:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16600/0x9c5536ccf89315fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.396029:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf89315f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c83 expref: 45 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.396099:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16600/0x9c5536ccf89315fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c83 expref: 44 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.396109:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:2.0:1787862785.396112:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787862785.396116:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16600, rc 0) 00000100:00100000:2.0:1787862785.396170:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+44:14642:x1874709517053184:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 359us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.396178:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:0.0:1787862785.405440:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.405532:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517053440 00000100:00100000:1.0:1787862785.405544:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517053440 00000100:00100000:1.0:1787862785.405616:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 95 00000100:00100000:1.0:1787862785.405628:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+44:14642:x1874709517053440:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.405723:0:15473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.405742:0:15473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.405754:0:15473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787862785.406366:0:15473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787862785.406382:0:15473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 511170338081ns, next at 512170334231ns, rc = 0 00000004:00010000:1.0:1787862785.407462:0:15473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e12c421a reply state 00000000d133e958 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.407475:0:15473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787862785.407654:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+46:14642:x1874709517053440:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 2025us (2220us total) trans 8589934658 rc 0/0 00000100:00100000:1.0:1787862785.407664:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 95 00010000:00010000:1.0:1787862785.422370:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.422389:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.422397:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.422426:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:1.0:1787862785.422431:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.422452:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.422472:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:1.0:1787862785.422475:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787862785.422481:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.422488:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931602 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.423334:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.423629:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517053568 00000100:00100000:2.0:1787862785.423640:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517053568 00000100:00100000:2.0:1787862785.423697:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:2.0:1787862785.423708:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+45:14642:x1874709517053568:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862785.423736:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862785.423757:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c8a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.423819:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 46 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.423834:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 46 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.423872:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:2.0:1787862785.423876:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862785.423892:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17000, rc 0) 00000100:00100000:2.0:1787862785.423958:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+46:14642:x1874709517053568:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 252us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.423966:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 96 00000100:00100000:0.0:1787862785.447153:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.447284:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517053696 00000100:00100000:1.0:1787862785.447295:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517053696 00000100:00100000:1.0:1787862785.447385:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787862785.447397:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517053696:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787862785.448259:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517053696:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 862us (1115us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787862785.448269:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00080000:0.0:1787862785.448810:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862785.463840:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.464518:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517053952 00000100:00100000:1.0:1787862785.464530:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517053952 00000100:00100000:1.0:1787862785.464614:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:1.0:1787862785.464626:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65098fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+46:14642:x1874709517053952:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787862785.467707:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65098fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+47:14642:x1874709517053952:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 3071us (3865us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1787862785.467745:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 22 00000100:00100000:3.0:1787862785.483449:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.483543:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517054208 00000100:00100000:2.0:1787862785.483554:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517054208 00000100:00100000:2.0:1787862785.483620:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:2.0:1787862785.483630:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+47:14642:x1874709517054208:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787862785.483760:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+47:14642:x1874709517054208:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 131us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.483769:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:0.0:1787862785.508417:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.508523:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517054336 00000100:00100000:2.0:1787862785.508536:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517054336 00000100:00100000:2.0:1787862785.508592:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:2.0:1787862785.508619:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+47:14642:x1874709517054336:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862785.508643:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862785.508667:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17a00/0x9c5536ccf8931610 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c91 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.508788:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931617 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.508806:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.508819:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862785.508862:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862785.508895:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.508922:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17a00/0x9c5536ccf8931610 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c91 expref: 49 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.508942:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931617 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c91 expref: 48 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.508952:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:2.0:1787862785.508955:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787862785.508960:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a17800, rc 0) 00000100:00100000:2.0:1787862785.509033:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+48:14642:x1874709517054336:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 433us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.509309:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:0.0:1787862785.522757:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.522927:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517054464 00000100:00100000:1.0:1787862785.522939:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517054464 00000100:00100000:1.0:1787862785.523008:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:1.0:1787862785.523020:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517054464:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.523040:0:15001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862785.523286:0:15001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c98 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787862785.523335:0:15001:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a909f01, blocks: 0x1 00010000:00010000:1.0:1787862785.523360:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1787862785.523366:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862785.523378:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 7 pid: 15001 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.523402:0:15001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 7 pid: 15001 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.523419:0:15001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfca00, rc 0) 00000100:00100000:1.0:1787862785.523488:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2346:x1874709517054464:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 471us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.523497:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862785.530934:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.532271:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517054720 00000100:00100000:2.0:1787862785.532287:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517054720 00000100:00100000:2.0:1787862785.532360:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:2.0:1787862785.532371:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+48:14642:x1874709517054720:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787862785.532505:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+48:14642:x1874709517054720:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 135us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.532514:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:0.0:1787862785.541637:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.541796:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517054848 00000100:00100000:2.0:1787862785.541809:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517054848 00000100:00100000:2.0:1787862785.541872:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:2.0:1787862785.541883:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+48:14642:x1874709517054848:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787862785.626840:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934648 is committed 00000004:00080000:1.0:1787862785.626855:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787862785.626887:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6507d05a80 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1787862785.626909:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a653d87e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6507d05240 00000020:00080000:1.0:1787862785.626913:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a653d87ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6402afe800 00000001:00080000:1.0:1787862785.626937:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934659 is committed 00000004:00080000:1.0:1787862785.626944:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787862785.627003:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000100:00100000:0.0:1787862785.627333:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14642:x1874709517054848:12345-192.168.202.60@tcp:44:lhsmtool_posix.0 Request processed in 85447us (85702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862785.627346:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 100 00000100:00100000:0.0:1787862785.627550:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526468224:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1787862785.627956:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787862785.628256:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862785.628278:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526468352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787862785.628335:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862785.630288:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526468352 00000100:00100000:1.0:1787862785.630303:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526468352 00000100:00100000:1.0:1787862785.630394:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787862785.630405:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526468352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787862785.630732:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862785.630796:0:15001:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787862785.630806:0:15001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787862785.630916:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526468224 00000100:00100000:0.0:1787862785.630920:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526468224 00000100:00100000:0.0:1787862785.631012:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787862785.631021:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1874709526468224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787862785.631374:0:16604:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:0.0:1787862785.631415:0:16604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.631440:0:16604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.631450:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787862785.631454:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787862785.631459:0:16604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.631494:0:16604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.631521:0:16604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 7 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.631536:0:16604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16604:1874709526468480:192.168.202.60@tcp:104: 00002000:00010000:1.0:1787862785.631811:0:14998:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787862785.631816:0:14998:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787862785.631819:0:14998:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787862785.631821:0:14998:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787862785 -> 1787862785 00002000:00010000:1.0:1787862785.631823:0:14998:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787862785.631882:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1874709526468352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1477us (3545us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787862785.631890:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787862785.632387:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862785.632393:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787862785.632439:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a651f896580/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787862785.632446:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526468352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787862785.632699:0:16604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a640197f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787862785.636965:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.637216:0:16604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16604:1874709526468480:192.168.202.60@tcp:104: 00010000:00010000:3.0:1787862785.637247:0:16604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.638175:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517054976 00000100:00100000:2.0:1787862785.638185:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517054976 00000100:00100000:2.0:1787862785.638248:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:2.0:1787862785.638258:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517054976:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787862785.638397:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517054976:12345-192.168.202.60@tcp:16:lhsmtool_posix.0 Request processed in 139us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.638404:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:1.0:1787862785.651633:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.651772:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517055104 00000100:00100000:3.0:1787862785.651783:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517055104 00010000:00010000:3.0:1787862785.651833:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 8 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862785.651882:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:3.0:1787862785.651893:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2349:x1874709517055104:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862785.651909:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862785.651914:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 8 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.651931:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 8 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.651955:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ebb4fc7/0x9c5536ccf8931481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c28 expref: 8 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.651975:0:14301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862785.651994:0:14301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787862785.652001:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.652011:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.652103:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862785.652154:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2349:x1874709517055104:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 263us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862785.652162:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00010000:00010000:0.0:1787862785.655282:0:16604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.655310:0:16604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.655323:0:16604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.655330:0:16604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.655358:0:16604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787862785.655937:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787862785.655947:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.655956:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534636c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:1.0:1787862785.655960:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.655983:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.656003:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.656012:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9ed12c/0x9c5536ccf8931625 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.656034:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862785.656036:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862785.656073:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862785.659280:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526468224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28254us (28541us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787862785.659294:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1787862785.659884:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a651f894000/2, rc 0, transno 8589934600 00000100:00100000:2.0:1787862785.659894:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526468224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787862785.660776:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.660972:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517055360 00000100:00100000:2.0:1787862785.660980:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517055360 00000100:00100000:2.0:1787862785.661081:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:2.0:1787862785.661092:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14642:x1874709517055360:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787862785.661155:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862785.661182:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17800/0x9c5536ccf8931617 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c91 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.661201:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:2.0:1787862785.661207:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787862785.661255:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.661268:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.661280:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787862785.661889:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008418ca30 reply state 0000000002918daf transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.661901:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787862785.662012:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:14642:x1874709517055360:12345-192.168.202.60@tcp:36:lhsmtool_posix.0 Request processed in 921us (1240us total) trans 8589934660 rc 0/0 00000100:00100000:2.0:1787862785.662030:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:0.0:1787862785.668778:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:3.0:1787862785.669089:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.669102:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.669110:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.669116:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862785.669121:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.669129:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.669148:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:3.0:1787862785.669151:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862785.669172:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.669179:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16200/0x9c5536ccf893162c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.669482:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517055488 00000100:00100000:2.0:1787862785.669494:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517055488 00000100:00100000:2.0:1787862785.669553:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:2.0:1787862785.669564:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:14642:x1874709517055488:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787862785.669582:0:15000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862785.669729:0:15000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34c9f expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.669762:0:15000:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.669772:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862785.669776:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862785.669789:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.669825:0:15000:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.669840:0:15000:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.669855:0:15000:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15000:1874709526468608:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862785.669943:0:15000:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650910a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787862785.675904:0:15000:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15000:1874709526468608:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862785.675945:0:15000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.675968:0:15000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16c00, rc 0) 00000100:00100000:2.0:1787862785.676032:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:14642:x1874709517055488:12345-192.168.202.60@tcp:101:lhsmtool_posix.0 Request processed in 6470us (7264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.676084:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:3.0:1787862785.682841:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.683243:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517055616 00000100:00100000:1.0:1787862785.683254:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517055616 00010000:00010000:1.0:1787862785.683312:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.683352:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:1.0:1787862785.683361:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2348:x1874709517055616:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862785.683375:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862785.683397:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.683412:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.683454:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd492832/0x9c5536ccf893161e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c98 expref: 8 pid: 15001 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.683472:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862785.683476:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787862785.683483:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.683494:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.683531:0:14299:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.683548:0:14299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14299:1874709526468736:192.168.202.60@tcp:105: 00000100:00100000:1.0:1787862785.683670:0:14299:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517e409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862785.691817:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.691914:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517055744 00000100:00100000:3.0:1787862785.691924:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517055744 00000100:00100000:3.0:1787862785.691993:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:3.0:1787862785.692004:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2348:x1874709517055744:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787862785.692277:0:14998:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787862785.692281:0:14998:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787862785 00002000:00010000:3.0:1787862785.692284:0:14998:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787862784 00002000:00010000:3.0:1787862785.692287:0:14998:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787862785 -> 1787862785 00002000:00010000:3.0:1787862785.692289:0:14998:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787862785.692360:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:2348:x1874709517055744:12345-192.168.202.60@tcp:2:lhsmtool_posix.0 Request processed in 357us (554us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787862785.692369:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:1.0:1787862785.693363:0:14299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14299:1874709526468736:192.168.202.60@tcp:105: 00010000:00010000:1.0:1787862785.693390:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862785.693436:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2348:x1874709517055616:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 10066us (10598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862785.693447:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 27 00000100:00100000:0.0:1787862785.703548:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862785.703849:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517055872 00000100:00100000:2.0:1787862785.703861:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517055872 00000100:00100000:2.0:1787862785.703929:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:2.0:1787862785.703940:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2348:x1874709517055872:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787862785.703990:0:15001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.704025:0:15001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.704034:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787862785.704038:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862785.704092:0:15001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.704128:0:15001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.704142:0:15001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 8 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.704157:0:15001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15001:1874709526468864:192.168.202.60@tcp:104: 00000100:00100000:2.0:1787862785.704252:0:15001:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650910a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787862785.728874:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862785.729420:0:15001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e34b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15001:1874709526468864:192.168.202.60@tcp:104: 00010000:00010000:0.0:1787862785.729466:0:15001:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862785.737908:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517056000 00000100:00100000:3.0:1787862785.737925:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517056000 00010000:00010000:2.0:1787862785.755802:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 9 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.755873:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 28 00000100:00100000:2.0:1787862785.755887:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+9:2349:x1874709517056000:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787862785.755906:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787862785.755931:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 9 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.755966:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 9 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.755994:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3002819/0x9c5536ccf8931633 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c9f expref: 9 pid: 15000 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.756012:0:14301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862785.756016:0:14301:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787862785.757467:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.757497:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.757544:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787862785.757637:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2349:x1874709517056000:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 1752us (28774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862785.757649:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 28 00010000:00010000:0.0:1787862785.759942:0:15001:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.759962:0:15001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760005:0:15001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760014:0:15001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760078:0:15001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760094:0:15001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16800 already unused, calling callback (ffffffffc150b530) 00010000:00010000:0.0:1787862785.760098:0:15001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760108:0:15001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760171:0:15001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862785.760179:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065f2eb72/0x9c5536ccf893163a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862785.760282:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517055872:12345-192.168.202.60@tcp:1:lhsmtool_posix.0 Request processed in 56340us (56739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862785.760292:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:2.0:1787862785.787012:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862785.787323:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517056256 00000100:00100000:1.0:1787862785.787334:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517056256 00000100:00100000:1.0:1787862785.787391:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:1.0:1787862785.787413:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:14642:x1874709517056256:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787862785.787499:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787517:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787530:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787768:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787780:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 15 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787789:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787825:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 15 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862785.787838:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 15 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862785.787853:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526468992:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862785.787939:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517e409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787862785.800834:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534148780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526468992:192.168.202.60@tcp:104: 00010000:00010000:1.0:1787862785.800872:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.810847:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.818997:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517056384 00000100:00100000:3.0:1787862785.819013:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517056384 00010000:00010000:3.0:1787862785.819093:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 16 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862785.819194:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:3.0:1787862785.819206:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+16:2349:x1874709517056384:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787862785.819240:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787862785.819247:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 16 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.819263:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 16 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.819287:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17000/0x9c5536ccf8931609 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c8a expref: 16 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.819316:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:3.0:1787862785.819322:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.819331:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.819339:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.819378:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787862785.819452:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+15:2349:x1874709517056384:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 249us (8618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862785.819460:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00010000:00010000:2.0:1787862785.819522:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.819531:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787862785.819730:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934661 00000001:00080000:2.0:1787862785.819877:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934662 00000001:00080000:2.0:1787862785.819924:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000100:00100000:2.0:1787862785.820003:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e35680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874709526469120:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787862785.820123:0:14314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862785.820154:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650999df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787862785.820795:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526469120 00000100:00100000:0.0:1787862785.820805:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526469120 00000100:00100000:0.0:1787862785.820859:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787862785.820868:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1874709526469120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787862785.820965:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1874709526469120:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862785.820973:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787862785.822402:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e35680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874709526469120:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787862785.823358:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000100:00100000:2.0:1787862785.823469:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e35680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874709526469248:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787862785.823531:0:14314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862785.823571:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650999d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787862785.823745:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526469248 00000100:00100000:0.0:1787862785.823754:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526469248 00000100:00100000:0.0:1787862785.823811:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787862785.823821:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1874709526469248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787862785.824032:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14314:x1874709526469248:12345-0@lo:1000:mdt00_000.0 Request processed in 201us (489us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787862785.824072:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787862785.826948:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e35680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874709526469248:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787862785.827004:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827015:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827232:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827239:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfcc00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862785.827244:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827253:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827290:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:2.0:1787862785.827293:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862785.827298:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827305:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfcc00/0x9c5536ccf8931648 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827334:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827341:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827347:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827351:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862785.827354:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827359:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827367:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:2.0:1787862785.827369:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787862785.827376:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827388:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827403:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.827590:0:14314:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd200/0x9c5536ccf89315a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34c6e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.827639:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e36940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526469376:192.168.202.60@tcp:105: 00000100:00100000:2.0:1787862785.827740:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a650999d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862785.834796:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.835572:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e36940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526469376:192.168.202.60@tcp:105: 00010000:00010000:3.0:1787862785.835625:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835638:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16000/0x9c5536ccf8931599 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835700:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835716:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835730:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835742:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835749:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835756:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835762:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422ca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862785.835766:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835774:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835787:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:3.0:1787862785.835790:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787862785.835794:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835801:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422ca00/0x9c5536ccf893164f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835818:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835825:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835832:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835838:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6509bfca00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:3.0:1787862785.835841:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835847:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835855:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:3.0:1787862785.835858:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787862785.835861:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.835866:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfca00/0x9c5536ccf8931641 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862785.836167:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14642:x1874709517056256:12345-192.168.202.60@tcp:57:lhsmtool_posix.0 Request processed in 48753us (49163us total) trans 8589934665 rc 0/0 00000100:00100000:3.0:1787862785.836179:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000020:00080000:3.0:1787862785.836186:0:14314:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787862785.836434:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862785.836440:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862785.836488:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862785.836495:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862785.837006:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517056512 00000100:00100000:0.0:1787862785.837024:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517056512 00000100:00100000:0.0:1787862785.837119:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862785.837128:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14641:x1874709517056512:12345-192.168.202.60@tcp:49:bash.0 00000100:00100000:0.0:1787862785.837256:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14641:x1874709517056512:12345-192.168.202.60@tcp:49:bash.0 Request processed in 129us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862785.837264:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 23 00000100:00100000:0.0:1787862785.851407:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862785.851456:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862785.851559:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517056640 00000100:00100000:3.0:1787862785.851571:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517056640 00000100:00100000:3.0:1787862785.851664:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:3.0:1787862785.851684:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:14641:x1874709517056640:12345-192.168.202.60@tcp:101:bash.0 00010000:00010000:3.0:1787862785.851705:0:14998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862785.851727:0:14998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d628983f/0x9c5536ccf8931656 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34ca6 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787862785.851765:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a909f01, atime: 0x6a909f00, ctime: 0x6a909f01, blocks: 0x1 00010000:00010000:3.0:1787862785.851791:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1787862785.851796:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787862785.851807:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d628983f/0x9c5536ccf8931656 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ca6 expref: 8 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.851835:0:14998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d628983f/0x9c5536ccf8931656 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34ca6 expref: 8 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.851849:0:14998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422ca00, rc 0) 00000100:00100000:3.0:1787862785.851918:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:14641:x1874709517056640:12345-192.168.202.60@tcp:101:bash.0 Request processed in 243us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862785.851925:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:2.0:1787862785.860508:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517056896 00000100:00100000:2.0:1787862785.860526:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517056896 00000100:00100000:2.0:1787862785.860622:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 24 00000100:00100000:2.0:1787862785.860634:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+18:14642:x1874709517056896:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787862785.862631:0:14318:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787862785.862749:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00010000:00010000:2.0:1787862785.863226:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.863245:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.863258:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.863279:0:14318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.863285:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.863291:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862785.863323:0:14318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787862785.863452:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+20:14642:x1874709517056896:12345-192.168.202.60@tcp:35:lhsmtool_posix.0 Request processed in 2816us (11990us total) trans 8589934667 rc 0/0 00000100:00100000:2.0:1787862785.863464:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 24 00000020:00080000:2.0:1787862785.863470:0:14318:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787862785.865912:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787862785.865926:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.865946:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6510a16c00 already unused, calling callback (ffffffffc150b530) 00010000:00010000:3.0:1787862785.865950:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.865960:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.865990:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6507fe6f00) 00010000:00010000:3.0:1787862785.865993:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787862785.865998:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862785.866004:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16c00/0x9c5536ccf893165d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862785.866009:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00010000:00010000:3.0:1787862785.866025:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862785.866027:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862785.866028:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862785.866175:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517057152 00000100:00100000:0.0:1787862785.866186:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517057152 00000100:00100000:0.0:1787862785.866245:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:0.0:1787862785.866256:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+20:14641:x1874709517057152:12345-192.168.202.60@tcp:35:bash.0 00000001:00080000:0.0:1787862785.866612:0:14317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00000100:00100000:0.0:1787862785.866739:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:14641:x1874709517057152:12345-192.168.202.60@tcp:35:bash.0 Request processed in 485us (734us total) trans 8589934669 rc 0/0 00000100:00100000:0.0:1787862785.866748:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000020:00080000:0.0:1787862785.866753:0:14317:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787862786.049344:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862786.049527:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517057280 00000100:00100000:2.0:1787862786.049548:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517057280 00000100:00100000:2.0:1787862786.049659:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:2.0:1787862786.049670:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+22:14648:x1874709517057280:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:2.0:1787862786.049698:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787862786.049723:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf8931664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34cad expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.049794:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf893166b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.049808:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf893166b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.049839:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf893166b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862786.050100:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787862786.050105:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862786.050187:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf893166b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.050218:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a17200/0x9c5536ccf8931664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cad expref: 24 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.050238:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6510a16400/0x9c5536ccf893166b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cad expref: 23 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.050246:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:2.0:1787862786.050249:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787862786.050252:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6510a16400, rc 0) 00000100:00100000:2.0:1787862786.050335:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:14648:x1874709517057280:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 667us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862786.050343:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:3.0:1787862786.061194:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862786.061323:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517057408 00000100:00100000:0.0:1787862786.061336:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517057408 00000100:00100000:0.0:1787862786.061400:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:0.0:1787862786.061411:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+23:14648:x1874709517057408:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:0.0:1787862786.061434:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787862786.061458:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931672 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34cb4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.061528:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.061576:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.061589:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.061922:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.061931:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.061939:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062296:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062842:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062857:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787862786.062896:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:0.0:1787862786.062901:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787862786.062920:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062933:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062955:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062961:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062968:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062975:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637000 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862786.062979:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.062987:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063001:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:0.0:1787862786.063003:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862786.063009:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063015:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637000/0x9c5536ccf8931679 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063027:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063149:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063155:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063168:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6534637400 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:0.0:1787862786.063172:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063178:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063187:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517dfc400) 00010000:00010000:0.0:1787862786.063190:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787862786.063193:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063199:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534637400/0x9c5536ccf8931680 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063237:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636000/0x9c5536ccf8931672 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 25 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063252:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 24 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.063259:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:0.0:1787862786.063261:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787862786.063264:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6534636a00, rc 0) 00000100:00100000:0.0:1787862786.063352:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:14648:x1874709517057408:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 1942us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862786.063360:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 104 00000100:00100000:3.0:1787862786.071534:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862786.071663:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517057664 00000100:00100000:1.0:1787862786.071675:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517057664 00000100:00100000:1.0:1787862786.071743:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:1.0:1787862786.071754:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+24:14648:x1874709517057664:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:1.0:1787862786.071777:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787862786.071797:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893168e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34cbb expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.071905:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.071921:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 25 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.071932:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.071967:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 25 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.071982:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 25 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862786.071998:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526469504:192.168.202.60@tcp:104: 00000100:00100000:1.0:1787862786.072135:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a6517e409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787862786.075110:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14316:1874709526469504:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862786.075146:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862786.079529:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862786.079592:0:16549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517057792 00000100:00100000:0.0:1787862786.079629:0:16549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517057792 00010000:00010000:0.0:1787862786.079675:0:16549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 26 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787862786.079720:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:0.0:1787862786.079731:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a652e18ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:2349:x1874709517057792:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787862786.079748:0:16549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787862786.079755:0:16549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 26 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.079771:0:16549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 26 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.079795:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6534636a00/0x9c5536ccf8931687 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cb4 expref: 26 pid: 14315 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.079813:0:16549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:0.0:1787862786.079819:0:16549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.079829:0:16549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.079837:0:16549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787862786.079877:0:16549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787862786.079939:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a652e18ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+25:2349:x1874709517057792:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 209us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862786.079959:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00010000:00010000:1.0:1787862786.080240:0:14316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.080257:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787862786.080279:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787862786.080427:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfc200/0x9c5536ccf893168e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 26 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.080444:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 25 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.080452:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787862786.080455:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787862786.080457:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6509bfd000, rc 0) 00000100:00100000:1.0:1787862786.080484:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+25:14648:x1874709517057664:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 8733us (8963us total) trans 8589934670 rc 0/0 00000100:00100000:1.0:1787862786.080491:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 105 00000100:00100000:1.0:1787862786.160891:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862786.160999:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517057920 00000100:00100000:3.0:1787862786.161011:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517057920 00000100:00100000:3.0:1787862786.161109:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:3.0:1787862786.161120:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+25:14650:x1874709517057920:12345-192.168.202.60@tcp:101:lfs.0 00010000:00010000:3.0:1787862786.161148:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787862786.161171:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89316a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x455be29b75b34cc2 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161238:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161254:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161266:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161295:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161304:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161311:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161615:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161628:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 26 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161636:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161667:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 26 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787862786.161682:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 26 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787862786.161696:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526469632:192.168.202.60@tcp:104: 00000100:00100000:3.0:1787862786.162189:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a651ff7a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787862786.172521:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862786.172641:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058176 00000100:00100000:0.0:1787862786.172652:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058176 00000100:00100000:0.0:1787862786.172714:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:0.0:1787862786.172724:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:13743:x1874709517058176:12345-192.168.202.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787862786.172984:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+28:13743:x1874709517058176:12345-192.168.202.60@tcp:35:ldlm_bl.0 Request processed in 260us (476us total) trans 8589934671 rc 0/0 00000100:00100000:0.0:1787862786.172991:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:2.0:1787862786.173578:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031df840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874709526469632:192.168.202.60@tcp:104: 00010000:00010000:2.0:1787862786.173622:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787862786.176339:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862786.176608:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058304 00000100:00100000:1.0:1787862786.176618:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058304 00010000:00010000:1.0:1787862786.176659:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 28 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787862786.176702:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:1.0:1787862786.176712:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+28:2346:x1874709517058304:12345-192.168.202.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787862786.176726:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787862786.176735:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 28 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.176765:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 28 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.176789:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6509bfd000/0x9c5536ccf8931695 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cbb expref: 28 pid: 14316 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.176811:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:1.0:1787862786.176819:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.176831:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.176839:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787862786.176877:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787862786.176950:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+27:2346:x1874709517058304:12345-192.168.202.60@tcp:103:ldlm_bl.0 Request processed in 240us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862786.176958:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00010000:00010000:2.0:1787862786.177331:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177341:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787862786.177393:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:2.0:1787862786.177398:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787862786.177420:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177435:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177445:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177452:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177458:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177465:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422c200 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862786.177469:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177477:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177489:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a65178bf700) 00010000:00010000:2.0:1787862786.177502:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862786.177507:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177514:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422c200/0x9c5536ccf89316aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177527:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177533:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177538:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177542:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a653422da00 already unused, calling callback (ffffffffc1f2a4f0) 00010000:00010000:2.0:1787862786.177545:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177561:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177570:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6517c53c00) 00010000:00010000:2.0:1787862786.177573:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787862786.177576:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177583:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422da00/0x9c5536ccf89316b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177638:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422d200/0x9c5536ccf89316a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cc2 expref: 27 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177666:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a653422dc00/0x9c5536ccf89316b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.60@tcp remote: 0x455be29b75b34cc2 expref: 26 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787862786.177674:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6507fe6500) 00010000:00010000:2.0:1787862786.177677:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787862786.177679:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a653422dc00, rc 0) 00000100:00100000:2.0:1787862786.177720:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:14650:x1874709517057920:12345-192.168.202.60@tcp:101:lfs.0 Request processed in 16602us (16839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862786.177728:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:2.0:1787862786.249200:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862786.249256:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862786.249398:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058560 00000100:00100000:0.0:1787862786.249410:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058560 00000100:00100000:0.0:1787862786.249470:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:0.0:1787862786.249481:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2347:x1874709517058560:12345-192.168.202.60@tcp:16:kworker.0 00000100:00100000:0.0:1787862786.249653:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2347:x1874709517058560:12345-192.168.202.60@tcp:16:kworker.0 Request processed in 173us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862786.249661:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 31 00000100:00100000:3.0:1787862786.250163:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058432 00000100:00100000:3.0:1787862786.250180:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058432 00002000:00100000:3.0:1787862786.250212:0:15004:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->12) req@ffff9a65346e4f00 x1874709517058432/t0(0) o4->7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp:147/0 lens 504/0 e 0 to 0 dl 1787862797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787862786.250222:0:15004:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65346e4f00 with x1874709517058432 ext(0->12) 00002000:00010000:3.0:1787862786.250228:0:15004:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a65346e4f00 00000100:00100000:3.0:1787862786.250256:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 2 00000100:00100000:3.0:1787862786.250264:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+8:2347:x1874709517058432:12345-192.168.202.60@tcp:4:bash.0 00000100:00100000:3.0:1787862786.251131:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+10:2347:x1874709517058432:12345-192.168.202.60@tcp:4:bash.0 Request processed in 864us (1871us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787862786.251141:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 2 00002000:00100000:3.0:1787862786.251149:0:15004:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->12) req@ffff9a65346e4f00 x1874709517058432/t8589934598(0) o4->7a16fbf5-07bd-4add-b9e9-3111232e9331@192.168.202.60@tcp:147/0 lens 504/448 e 0 to 0 dl 1787862797 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787862786.251158:0:15004:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9a65346e4f00 with x1874709517058432 ext(0->12) 00002000:00010000:3.0:1787862786.251162:0:15004:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a65346e4f00 00010000:00010000:1.0:1787862786.396279:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862787.167562:0:16642:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862787.167572:0:16642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862787.167702:0:16642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862787.167710:0:16642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862787.276549:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.276608:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.276637:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.276656:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.276704:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.276736:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058944 00000100:00100000:3.0:1787862787.276746:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058944 00000100:00100000:3.0:1787862787.276807:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059072 00000100:00100000:3.0:1787862787.276810:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059072 00000100:00100000:3.0:1787862787.276835:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1787862787.276846:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517058944:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862787.276924:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+7:2348:x1874709517058944:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 79us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862787.276955:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 25 00000100:00100000:3.0:1787862787.276981:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:3.0:1787862787.276989:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+10:2348:x1874709517059072:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862787.277036:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+10:2348:x1874709517059072:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862787.277061:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 26 00000100:00100000:3.0:1787862787.277086:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059200 00000100:00100000:3.0:1787862787.277089:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059200 00000100:00100000:3.0:1787862787.277118:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058816 00000100:00100000:3.0:1787862787.277120:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058816 00000100:00100000:3.0:1787862787.277140:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:3.0:1787862787.277147:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517059200:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862787.277177:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517059200:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 31us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862787.277183:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:3.0:1787862787.277195:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00100000:3.0:1787862787.277200:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:2348:x1874709517058816:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862787.277225:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+26:2348:x1874709517058816:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862787.277232:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 38 00000100:00080000:3.0:1787862787.277255:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862787.277261:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862787.277262:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862787.278403:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517058688 00000100:00100000:0.0:1787862787.278414:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517058688 00000100:00100000:0.0:1787862787.278474:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:0.0:1787862787.278482:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517058688:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862787.278532:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517058688:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 51us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862787.278553:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:3.0:1787862787.289661:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.289714:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862787.289770:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059328 00000100:00100000:3.0:1787862787.289780:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059328 00000100:00100000:3.0:1787862787.289842:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059456 00000100:00100000:3.0:1787862787.289846:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059456 00000100:00100000:2.0:1787862787.290151:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:2.0:1787862787.290166:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2345:x1874709517059328:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:2.0:1787862787.290205:0:14998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf893109f 00000100:00080000:2.0:1787862787.290222:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a652731c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862787.290265:0:14998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787862787.290557:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+2:2345:x1874709517059328:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 394us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862787.290567:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 32 00000100:00100000:2.0:1787862787.290604:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:2.0:1787862787.290612:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+5:2345:x1874709517059456:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:2.0:1787862787.290626:0:14998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf89310a6 00000100:00080000:2.0:1787862787.290634:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a6504e69000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862787.290659:0:14998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1787862787.290794:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+2:2345:x1874709517059456:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 182us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862787.290801:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00010000:00010000:2.0:1787862787.290821:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862787.291067:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787862787.291086:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862787.291091:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862787.420623:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862788.252834:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526470016:0@lo:400:kworker.0 00000100:00100000:2.0:1787862788.252925:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862788.253000:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862788.253007:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526469888:0@lo:400:kworker.0 00000100:00100000:2.0:1787862788.253081:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862788.253105:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526470400:0@lo:400:kworker.0 00000100:00100000:2.0:1787862788.253146:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862788.253178:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470016 00000100:00100000:2.0:1787862788.253186:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470016 00000100:00100000:2.0:1787862788.253237:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526469888 00000100:00100000:2.0:1787862788.253241:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526469888 00000100:00100000:2.0:1787862788.253261:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787862788.253270:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526470016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253478:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526469760:0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253516:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862788.253539:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526470272:0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253562:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862788.253602:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862788.253609:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526470144:0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253632:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862788.253664:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470400 00000100:00100000:0.0:1787862788.253667:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470400 00000100:00100000:0.0:1787862788.253697:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470272 00000100:00100000:0.0:1787862788.253700:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470272 00000100:00100000:0.0:1787862788.253713:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470144 00000100:00100000:0.0:1787862788.253715:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470144 00000100:00100000:0.0:1787862788.253729:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862788.253735:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253796:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526470400:12345-0@lo:400:kworker.0 Request processed in 61us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862788.253803:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862788.253823:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862788.253828:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526470272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253855:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526470272:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862788.253860:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787862788.253869:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862788.253874:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526470144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253915:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526470144:12345-0@lo:400:kworker.0 Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862788.253921:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787862788.253959:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526470144:0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253967:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526470272:0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.253993:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526470400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862788.254297:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526469760 00000100:00100000:1.0:1787862788.254301:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526469760 00000100:00100000:1.0:1787862788.254335:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787862788.254343:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526469760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862788.254385:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526469760:12345-0@lo:400:kworker.0 Request processed in 44us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862788.254402:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787862788.254436:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526469760:0@lo:400:kworker.0 00000100:00100000:3.0:1787862788.255082:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862788.255093:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526469888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862788.255831:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862788.255848:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526470528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862788.255898:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787862788.255977:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862788.255983:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862788.255986:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862788.256037:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470528 00000100:00100000:0.0:1787862788.256064:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470528 00000100:00100000:0.0:1787862788.256101:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862788.256109:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3281:x1874709526470528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862788.257479:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1874709526469888:12345-0@lo:400:kworker.0 Request processed in 2385us (4394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862788.257492:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787862788.257554:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526469888:0@lo:400:kworker.0 00000100:00100000:2.0:1787862788.258907:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3282:x1874709526470016:12345-0@lo:400:kworker.0 Request processed in 5631us (5975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862788.258920:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862788.259412:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526470016:0@lo:400:kworker.0 00002000:00000024:0.0:1787862788.263224:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862788.263338:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874709526470528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7224us (7434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862788.263352:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787862788.263438:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526470528:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787862788.360775:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1787862788.360798:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:3.0:1787862788.360805:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000020:00000080:3.0:1787862788.360810:0:7633:0:(genops.c:885:class_export_put()) final put ffff9a6504e6c800/1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000001:00080000:3.0:1787862788.360838:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000020:00000080:2.0:1787862788.363392:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6504e6c800/1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf for lustre-OST0001 00000020:00000080:2.0:1787862788.363471:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6504e69000 for lustre-OST0001 00000001:00080000:2.0:1787862788.383635:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:2.0:1787862788.383654:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00100000:2.0:1787862788.383661:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000020:00000080:2.0:1787862788.383666:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a652731d800/1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf 00000001:00080000:2.0:1787862788.383715:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000020:00000080:1.0:1787862788.385085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a652731d800/1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf for lustre-OST0000 00000020:00000080:1.0:1787862788.385447:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a652731c000 for lustre-OST0000 00010000:00010000:0.0:1787862788.444551:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862789.291309:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862789.291349:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526470656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862789.291443:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862789.291552:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470656 00000100:00100000:2.0:1787862789.291560:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470656 00000100:00100000:2.0:1787862789.291626:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862789.291641:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526470656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862789.291683:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862789.291736:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526470656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862789.291752:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787862789.291796:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 2 00000004:00080000:2.0:1787862789.291808:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934600 00000004:00080000:2.0:1787862789.291835:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a651f894000, transno 8589934600 00000100:00100000:2.0:1787862789.291858:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526470656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862789.476286:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862789.498253:0:16695:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862789.498262:0:16695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862789.498305:0:16695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862789.498312:0:16695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862790.493174:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787862790.917748:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934671 is committed 00000020:00080000:1.0:1787862790.917780:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:1.0:1787862790.917807:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a650999df00 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:1.0:1787862790.917813:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a651c232a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a650999d900 00000020:00080000:1.0:1787862790.917817:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a651c232400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6534410800 00000020:00080000:1.0:1787862790.917838:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 4294967527 00000020:00080000:1.0:1787862790.918090:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:2.0:1787862791.516779:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862791.603389:0:16748:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862791.603399:0:16748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862791.603448:0:16748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862791.603455:0:16748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862792.403193:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862792.403250:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862792.403292:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862792.403348:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862792.403380:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862792.403411:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060096 00000100:00100000:0.0:1787862792.403421:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060096 00000100:00100000:0.0:1787862792.403488:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059712 00000100:00100000:0.0:1787862792.403492:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059712 00000100:00100000:0.0:1787862792.403515:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:0.0:1787862792.403525:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517060096:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862792.403615:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517060096:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862792.403623:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 42 00000100:00100000:0.0:1787862792.403641:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862792.403648:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517059712:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862792.403672:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517059712:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862792.403678:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862792.403697:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059840 00000100:00100000:0.0:1787862792.403700:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059840 00000100:00100000:0.0:1787862792.403722:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059968 00000100:00100000:0.0:1787862792.403725:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059968 00000100:00100000:0.0:1787862792.403741:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:0.0:1787862792.403747:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2349:x1874709517059840:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862792.403770:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2349:x1874709517059840:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862792.403777:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 29 00000100:00100000:0.0:1787862792.403786:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00100000:0.0:1787862792.403799:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517059968:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862792.403821:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517059968:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862792.403827:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 30 00000100:00080000:0.0:1787862792.403842:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862792.403846:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862792.403849:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862792.404135:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517059584 00000100:00100000:3.0:1787862792.404141:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517059584 00000100:00100000:3.0:1787862792.404168:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:3.0:1787862792.404174:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517059584:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862792.404202:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517059584:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862792.404209:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00010000:00010000:1.0:1787862792.540312:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862793.373340:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526470784:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.373424:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862793.373478:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526471296:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.373506:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862793.373548:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862793.373564:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526471168:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.373589:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862793.373619:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526470912:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.373646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862793.373664:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526471424:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.373686:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862793.373704:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862793.373710:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526471040:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.373731:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862793.373968:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470784 00000100:00100000:2.0:1787862793.373977:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470784 00000100:00100000:2.0:1787862793.374023:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787862793.374033:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526470784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374110:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526470784:12345-0@lo:400:kworker.0 Request processed in 78us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862793.374119:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787862793.374153:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471296 00000100:00100000:2.0:1787862793.374157:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471296 00000100:00100000:2.0:1787862793.374191:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471168 00000100:00100000:2.0:1787862793.374194:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471168 00000100:00100000:2.0:1787862793.374206:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471424 00000100:00100000:2.0:1787862793.374208:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471424 00000100:00100000:2.0:1787862793.374223:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787862793.374230:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526471296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374265:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526471296:12345-0@lo:400:kworker.0 Request processed in 35us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862793.374272:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787862793.374293:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787862793.374300:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526471168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374331:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526471168:12345-0@lo:400:kworker.0 Request processed in 32us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862793.374338:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787862793.374350:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862793.374357:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374390:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526471424:12345-0@lo:400:kworker.0 Request processed in 33us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862793.374396:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862793.374420:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526470912 00000100:00100000:2.0:1787862793.374424:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526470912 00000100:00100000:2.0:1787862793.374452:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471040 00000100:00100000:2.0:1787862793.374455:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471040 00000100:00100000:2.0:1787862793.374477:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862793.374483:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526470912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374514:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526470912:12345-0@lo:400:kworker.0 Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862793.374520:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787862793.374546:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862793.374552:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526471040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374578:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526471040:12345-0@lo:400:kworker.0 Request processed in 27us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862793.374584:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787862793.374674:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526471168:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374685:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526470784:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374705:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526471296:0@lo:400:kworker.0 00000100:00080000:2.0:1787862793.374734:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862793.374738:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862793.374740:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862793.374757:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787862793.374762:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a651f896580, transno 8589934595 00000004:00080000:2.0:1787862793.374774:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787862793.374796:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526471040:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374807:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401a41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526470912:0@lo:400:kworker.0 00000100:00100000:2.0:1787862793.374816:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526471424:0@lo:400:kworker.0 00000100:00100000:3.0:1787862793.383979:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526471552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862793.385866:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862793.385940:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471552 00000100:00100000:0.0:1787862793.385950:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471552 00000100:00100000:0.0:1787862793.386004:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787862793.386014:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526471552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862793.386069:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862793.386121:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526471552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862793.386129:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787862793.386217:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526471552:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787862793.434721:0:16799:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862793.434731:0:16799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862793.434777:0:16799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787862793.434785:0:16799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862793.572816:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862794.012312:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862794.012322:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862794.012355:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862794.012363:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862794.396254:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526471680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862794.396335:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862794.396469:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471680 00000100:00100000:0.0:1787862794.396478:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471680 00000100:00100000:0.0:1787862794.396552:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787862794.396562:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526471680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862794.396600:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862794.400532:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526471680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3945us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862794.400572:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787862794.401707:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526471680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862794.589570:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862795.612491:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862795.625143:0:16850:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862795.625153:0:16850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862795.625206:0:16850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862795.625212:0:16850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:00080000:3.0:1787862796.019390:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:1.0:1787862796.020910:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:1.0:1787862796.020941:0:14353:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:1.0:1787862796.636474:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862797.396895:0:16902:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862797.396905:0:16902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862797.396954:0:16902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862797.396960:0:16902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862797.513612:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862797.513655:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862797.513687:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862797.513707:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862797.513733:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862797.513763:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060480 00000100:00100000:3.0:1787862797.513773:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060480 00000100:00100000:3.0:1787862797.513832:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060608 00000100:00100000:3.0:1787862797.513835:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060608 00000100:00100000:3.0:1787862797.513859:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862797.513871:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2346:x1874709517060480:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862797.513948:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2346:x1874709517060480:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862797.513955:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 33 00000100:00100000:3.0:1787862797.513971:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:3.0:1787862797.513978:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517060608:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862797.514019:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517060608:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 41us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862797.514025:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:3.0:1787862797.514061:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060352 00000100:00100000:3.0:1787862797.514065:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060352 00000100:00100000:3.0:1787862797.514091:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060736 00000100:00100000:3.0:1787862797.514094:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060736 00000100:00100000:3.0:1787862797.514113:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:3.0:1787862797.514120:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517060352:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862797.514147:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517060352:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862797.514154:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 47 00000100:00100000:3.0:1787862797.514165:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:3.0:1787862797.514170:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517060736:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862797.514190:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517060736:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 20us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862797.514212:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00080000:3.0:1787862797.514235:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862797.514240:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862797.514242:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862797.514556:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060224 00000100:00100000:0.0:1787862797.514561:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060224 00000100:00100000:0.0:1787862797.514592:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 129 00000100:00100000:0.0:1787862797.514600:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517060224:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862797.514632:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517060224:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862797.514639:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 129 00010000:00010000:3.0:1787862797.660387:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862798.492391:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862798.492725:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862798.494087:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471808 00000100:00100000:3.0:1787862798.494106:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471808 00000100:00100000:3.0:1787862798.494191:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787862798.494204:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862798.494259:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862798.494354:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862798.494362:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787862798.494388:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862798.496280:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862798.501393:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526471936:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.501490:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862798.501567:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526471936 00000100:00100000:0.0:1787862798.501575:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526471936 00000100:00100000:0.0:1787862798.501619:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787862798.501628:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526471936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.501678:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526471936:12345-0@lo:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862798.501685:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787862798.501728:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526471936:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.501766:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526472064:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.501792:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862798.501821:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472064 00000100:00100000:0.0:1787862798.501825:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472064 00000100:00100000:0.0:1787862798.501861:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787862798.501868:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526472064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.501916:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526472064:12345-0@lo:400:kworker.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862798.501923:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787862798.501949:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526472064:0@lo:400:kworker.0 00000100:00080000:0.0:1787862798.501964:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862798.501993:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526472192:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502019:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862798.502067:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472192 00000100:00100000:0.0:1787862798.502071:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472192 00000100:00100000:0.0:1787862798.502098:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862798.502105:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526472192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502139:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526472192:12345-0@lo:400:kworker.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862798.502146:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862798.502172:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526472192:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502220:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526472320:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502244:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862798.502285:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526472448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502308:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862798.502336:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472320 00000100:00100000:0.0:1787862798.502339:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472320 00000100:00100000:0.0:1787862798.502359:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472448 00000100:00100000:0.0:1787862798.502361:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472448 00000100:00100000:0.0:1787862798.502377:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862798.502382:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526472320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502427:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526472320:12345-0@lo:400:kworker.0 Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862798.502434:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862798.502447:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787862798.502453:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526472448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862798.502498:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526472448:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862798.502504:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787862798.502531:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526472448:0@lo:400:kworker.0 00000100:00080000:0.0:1787862798.502546:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862798.502558:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526472320:0@lo:400:kworker.0 00010000:00010000:1.0:1787862798.685546:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862799.412675:0:16956:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862799.412684:0:16956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862799.412729:0:16956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862799.412736:0:16956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862799.517460:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862799.517497:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526472576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862799.517574:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862799.517694:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472576 00000100:00100000:2.0:1787862799.517703:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472576 00000100:00100000:2.0:1787862799.517759:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862799.517770:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526472576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862799.517807:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862799.517860:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526472576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862799.517868:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787862799.517926:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526472576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862799.708528:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862800.733122:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862801.500098:0:17007:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862801.500108:0:17007:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862801.500157:0:17007:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862801.500163:0:17007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862801.756327:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862802.638402:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862802.638475:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862802.638516:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862802.638546:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862802.638575:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061248 00000100:00100000:3.0:1787862802.638585:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061248 00000100:00100000:3.0:1787862802.638761:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:3.0:1787862802.638774:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517061248:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862802.638847:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517061248:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 76us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862802.638854:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 36 00000100:00100000:3.0:1787862802.638875:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060992 00000100:00100000:3.0:1787862802.638879:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060992 00000100:00100000:3.0:1787862802.639022:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061376 00000100:00100000:3.0:1787862802.639026:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061376 00000100:00100000:3.0:1787862802.639219:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:3.0:1787862802.639229:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517060992:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862802.639261:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517060992:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862802.639342:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517060864 00000100:00100000:1.0:1787862802.639347:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517060864 00000100:00100000:1.0:1787862802.639379:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:1.0:1787862802.639386:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517060864:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862802.639413:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517060864:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862802.639419:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 131 00000100:00100000:1.0:1787862802.639477:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:1.0:1787862802.639485:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517061376:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862802.639511:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517061376:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862802.639517:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00080000:0.0:1787862802.640037:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862802.640062:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862802.640993:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 52 00000100:00100000:0.0:1787862802.647907:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862802.648176:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061120 00000100:00100000:3.0:1787862802.648189:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061120 00000100:00100000:3.0:1787862802.648293:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00100000:3.0:1787862802.648305:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517061120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862802.648387:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2348:x1874709517061120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 85us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862802.648395:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 37 00000100:00080000:0.0:1787862802.649575:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787862802.780181:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862803.359874:0:17058:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862803.359882:0:17058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862803.359928:0:17058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862803.359935:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862803.619404:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862803.619450:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526472704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862803.619536:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862803.621960:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472704 00000100:00100000:2.0:1787862803.621976:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472704 00000100:00080000:3.0:1787862803.622719:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862803.624531:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862803.624555:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526472704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862803.624610:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862803.624919:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526472704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 301us (5311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862803.624930:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787862803.629470:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526472704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862803.630690:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526473216:0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.630778:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862803.630824:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787862803.630830:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526472832:0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.630859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862803.630899:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526473344:0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.630922:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862803.630953:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473216 00000100:00100000:1.0:1787862803.630962:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473216 00000100:00100000:1.0:1787862803.631022:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473344 00000100:00100000:1.0:1787862803.631059:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473344 00000100:00100000:2.0:1787862803.631634:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526472960:0@lo:400:kworker.0 00000100:00100000:2.0:1787862803.631696:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862803.631724:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862803.631731:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526473088:0@lo:400:kworker.0 00000100:00100000:2.0:1787862803.631756:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862803.631816:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472960 00000100:00100000:2.0:1787862803.631822:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472960 00000100:00100000:2.0:1787862803.631874:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787862803.631897:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526472960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.631919:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473088 00000100:00100000:1.0:1787862803.631922:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473088 00000100:00100000:1.0:1787862803.631935:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862803.631942:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526473216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862803.631956:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526472960:12345-0@lo:400:kworker.0 Request processed in 63us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862803.631964:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787862803.631977:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526473216:12345-0@lo:400:kworker.0 Request processed in 37us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862803.631983:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862803.631997:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862803.632003:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526473344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.632030:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526473344:12345-0@lo:400:kworker.0 Request processed in 28us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862803.632036:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787862803.632068:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787862803.632075:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526473088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.632101:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526473088:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862803.632107:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787862803.632159:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526473344:0@lo:400:kworker.0 00000100:00100000:1.0:1787862803.632172:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526473216:0@lo:400:kworker.0 00000100:00100000:2.0:1787862803.632346:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526473088:0@lo:400:kworker.0 00000100:00100000:2.0:1787862803.632357:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526472960:0@lo:400:kworker.0 00000100:00100000:0.0:1787862803.633401:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526472832 00000100:00100000:0.0:1787862803.633411:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526472832 00000100:00100000:0.0:1787862803.633463:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787862803.633472:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526472832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862803.633541:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526472832:12345-0@lo:400:kworker.0 Request processed in 70us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862803.633548:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787862803.633621:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526472832:0@lo:400:kworker.0 00000100:00080000:3.0:1787862803.647347:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862803.647360:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787862803.804374:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862804.252527:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862804.252539:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862804.252589:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862804.252597:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862804.636701:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862804.636729:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526473472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862804.636813:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862804.637022:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473472 00000100:00100000:3.0:1787862804.637032:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473472 00000100:00100000:3.0:1787862804.637113:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787862804.637134:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526473472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862804.637172:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862804.637225:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526473472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862804.637232:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787862804.637306:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526473472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862804.828200:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862805.702936:0:17110:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862805.702948:0:17110:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862805.702992:0:17110:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862805.703000:0:17110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862805.853636:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862806.887649:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862807.758147:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862807.758237:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862807.759085:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061632 00000100:00100000:3.0:1787862807.759106:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061632 00000100:00100000:3.0:1787862807.759180:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00100000:3.0:1787862807.759191:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517061632:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862807.759292:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517061632:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 102us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862807.759301:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 57 00000100:00080000:2.0:1787862807.759579:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862807.760017:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061504 00000100:00100000:1.0:1787862807.760024:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061504 00000100:00100000:1.0:1787862807.760074:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:1.0:1787862807.760102:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517061504:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862807.760154:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517061504:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 64us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862807.760161:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:2.0:1787862807.770101:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862807.770141:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862807.770179:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862807.770220:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061888 00000100:00100000:2.0:1787862807.770232:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061888 00000100:00100000:2.0:1787862807.770298:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517061760 00000100:00100000:2.0:1787862807.770302:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517061760 00000100:00100000:2.0:1787862807.770327:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:2.0:1787862807.770338:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517061888:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862807.770425:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517061888:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 88us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862807.770433:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 39 00000100:00100000:2.0:1787862807.770466:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:2.0:1787862807.770472:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+5:2345:x1874709517061760:12345-192.168.202.60@tcp:9:kworker.0 00000020:00000080:2.0:1787862807.770500:0:14998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9c5536ccf8931067 00000100:00080000:2.0:1787862807.770510:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9a6401bc2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787862807.770555:0:14998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787862807.770801:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+2:2345:x1874709517061760:12345-192.168.202.60@tcp:9:kworker.0 Request processed in 328us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862807.770808:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 34 00000100:00100000:1.0:1787862807.770992:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062016 00000100:00100000:1.0:1787862807.770998:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062016 00000100:00100000:1.0:1787862807.771036:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00100000:1.0:1787862807.771059:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517062016:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862807.771105:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517062016:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 62us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862807.771111:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 58 00000100:00080000:1.0:1787862807.771151:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862807.771155:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862807.771157:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787862807.771250:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862807.903240:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862808.029263:0:17161:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862808.029272:0:17161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862808.029319:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862808.029326:0:17161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862808.733466:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862808.733498:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526473600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862808.733593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862808.734120:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473600 00000100:00100000:2.0:1787862808.734130:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473600 00000100:00100000:2.0:1787862808.734201:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862808.734213:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526473600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862808.734258:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862808.734315:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526473600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862808.734323:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787862808.734399:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526473600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862808.735320:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526473728:0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735379:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862808.735436:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526474240:0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735466:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862808.735492:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862808.735498:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526473856:0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735522:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862808.735573:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474240 00000100:00100000:2.0:1787862808.735579:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474240 00000100:00100000:2.0:1787862808.735620:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862808.735628:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526474240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735675:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526474240:12345-0@lo:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862808.735681:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787862808.735699:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473856 00000100:00100000:2.0:1787862808.735703:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473856 00000100:00100000:2.0:1787862808.735726:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862808.735731:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735759:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526473856:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862808.735765:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787862808.735784:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526474112:0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735805:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862808.735825:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862808.735830:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526473984:0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735852:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862808.735876:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474112 00000100:00100000:2.0:1787862808.735879:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474112 00000100:00100000:2.0:1787862808.735903:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473984 00000100:00100000:2.0:1787862808.735907:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473984 00000100:00100000:2.0:1787862808.735920:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862808.735926:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.735960:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526474112:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862808.735966:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862808.735986:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862808.735992:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.736022:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526473984:12345-0@lo:400:kworker.0 Request processed in 30us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862808.736027:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862808.736204:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526473728 00000100:00100000:0.0:1787862808.736209:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526473728 00000100:00100000:0.0:1787862808.736244:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787862808.736252:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862808.736293:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526473728:12345-0@lo:400:kworker.0 Request processed in 42us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862808.736300:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787862808.736381:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526473856:0@lo:400:kworker.0 00000100:00100000:0.0:1787862808.736407:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526473728:0@lo:400:kworker.0 00000100:00100000:0.0:1787862808.736416:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526474240:0@lo:400:kworker.0 00000100:00080000:1.0:1787862808.736606:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862808.736614:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862808.736616:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862808.741127:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526473984:0@lo:400:kworker.0 00000100:00100000:2.0:1787862808.741173:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526474112:0@lo:400:kworker.0 00000001:00100000:3.0:1787862808.888636:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a16fbf5-07bd-4add-b9e9-3111232e9331 00000020:00000080:3.0:1787862808.888647:0:6696:0:(genops.c:885:class_export_put()) final put ffff9a6401bc6800/7a16fbf5-07bd-4add-b9e9-3111232e9331 00000020:00000080:0.0:1787862808.888725:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6401bc6800/7a16fbf5-07bd-4add-b9e9-3111232e9331 for lustre-OST0000 00000020:00000080:0.0:1787862808.888788:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6401bc2000 for lustre-OST0000 00010000:00010000:2.0:1787862808.924288:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862809.756640:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526474368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862809.756720:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862809.756848:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474368 00000100:00100000:3.0:1787862809.756856:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474368 00000100:00100000:3.0:1787862809.756916:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787862809.756927:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526474368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862809.756969:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862809.757021:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526474368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862809.757028:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787862809.757136:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526474368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862809.948201:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862810.246154:0:17213:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862810.246164:0:17213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862810.246206:0:17213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862810.246214:0:17213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862810.974013:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862812.000782:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862812.298918:0:17264:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862812.298930:0:17264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862812.298973:0:17264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862812.298980:0:17264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862812.873535:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862812.873583:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862812.873619:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862812.873689:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062272 00000100:00100000:1.0:1787862812.873701:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062272 00000100:00100000:1.0:1787862812.873769:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:2.0:1787862812.873780:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862812.873781:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517062272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00080000:2.0:1787862812.873817:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862812.873834:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062528 00000100:00100000:2.0:1787862812.873837:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062528 00000100:00100000:1.0:1787862812.873857:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517062272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862812.873864:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:3.0:1787862812.873929:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062400 00000100:00100000:3.0:1787862812.873933:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062400 00000100:00100000:3.0:1787862812.873975:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00100000:3.0:1787862812.873983:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517062400:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862812.874011:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517062400:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862812.874017:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 41 00000100:00080000:3.0:1787862812.874079:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862812.874083:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862812.876325:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062144 00000100:00100000:0.0:1787862812.876373:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062144 00000100:00100000:0.0:1787862812.876457:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:0.0:1787862812.876468:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517062144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862812.876542:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517062144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 76us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862812.876573:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:2.0:1787862812.877485:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 63 00000100:00100000:2.0:1787862812.877513:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517062528:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862812.877580:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517062528:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 85us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862812.877597:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 63 00010000:00010000:2.0:1787862813.020481:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862813.853739:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526474496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862813.853810:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862813.853890:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474496 00000100:00100000:1.0:1787862813.853897:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474496 00000100:00100000:1.0:1787862813.853960:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787862813.853971:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526474496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862813.854010:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862813.854097:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526474496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862813.854103:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787862813.854153:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526474496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862813.854248:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526474752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862813.854297:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862813.854302:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526474880:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854326:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862813.854369:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474752 00000100:00100000:1.0:1787862813.854373:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474752 00000100:00100000:1.0:1787862813.854427:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862813.854435:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526474752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854471:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526474752:12345-0@lo:400:kworker.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862813.854478:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787862813.854496:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474880 00000100:00100000:1.0:1787862813.854499:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474880 00000100:00100000:1.0:1787862813.854523:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787862813.854529:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526474880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854558:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526474880:12345-0@lo:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862813.854563:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787862813.854585:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526474624:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854610:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862813.854631:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65115470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526475136:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854650:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862813.854667:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862813.854672:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526475008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854693:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862813.854717:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526474624 00000100:00100000:1.0:1787862813.854721:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526474624 00000100:00100000:1.0:1787862813.854744:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787862813.854749:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526474624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854779:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526474624:12345-0@lo:400:kworker.0 Request processed in 30us (168us total) trans 0 rc 0/0 00000100:00080000:3.0:1787862813.854783:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862813.854785:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787862813.854788:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862813.854819:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475136 00000100:00100000:1.0:1787862813.854822:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475136 00000100:00100000:1.0:1787862813.854856:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475008 00000100:00100000:1.0:1787862813.854859:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475008 00000100:00100000:1.0:1787862813.854876:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787862813.854882:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526475136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854912:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526475136:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862813.854918:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787862813.854929:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862813.854935:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526475008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.854961:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526475008:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862813.854968:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787862813.854996:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862813.855003:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526474880:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.855013:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526474752:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.855037:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526475008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.855067:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526474624:0@lo:400:kworker.0 00000100:00100000:1.0:1787862813.855075:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65115470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526475136:0@lo:400:kworker.0 00010000:00010000:3.0:1787862814.045549:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862814.493378:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862814.493395:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862814.493439:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862814.493458:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1787862814.507197:0:17316:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862814.507212:0:17316:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862814.507266:0:17316:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862814.507276:0:17316:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862814.877216:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862814.885835:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526475264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862814.885965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862814.886592:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475264 00000100:00100000:1.0:1787862814.886606:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475264 00000100:00100000:1.0:1787862814.886707:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787862814.886719:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526475264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862814.886783:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862814.886874:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526475264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862814.886883:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787862814.887020:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526475264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862815.068453:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862816.098079:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862816.968614:0:17367:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862816.968628:0:17367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862816.968678:0:17367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862816.968686:0:17367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862817.119500:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862817.997618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862817.997695:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862817.997811:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862817.997953:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062912 00000100:00100000:1.0:1787862817.997959:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062784 00000100:00100000:0.0:1787862817.997967:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062912 00000100:00100000:1.0:1787862817.997968:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062784 00000100:00080000:2.0:1787862817.998182:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862817.998188:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862817.998228:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:2.0:1787862817.998241:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517062784:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862817.998378:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517062784:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 140us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862817.998387:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 67 00000100:00100000:3.0:1787862817.999587:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517062656 00000100:00100000:3.0:1787862817.999602:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517062656 00000100:00100000:0.0:1787862818.001372:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:0.0:1787862818.001400:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517062912:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862818.001510:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517062912:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 125us (3698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862818.001517:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 43 00000100:00100000:3.0:1787862818.007319:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:3.0:1787862818.008257:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517062656:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862818.008341:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862818.008528:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063040 00000100:00100000:0.0:1787862818.008540:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063040 00000100:00100000:0.0:1787862818.008637:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:0.0:1787862818.008647:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517063040:12345-192.168.202.60@tcp:400:kworker.0 00000100:00080000:1.0:1787862818.008720:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862818.012220:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517062656:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 3967us (14504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862818.012241:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:0.0:1787862818.013831:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517063040:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 5171us (5477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862818.013877:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00010000:00010000:0.0:1787862818.140430:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862818.975437:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862818.975474:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65115470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526475392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862818.975589:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862818.977226:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526475904:0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.977332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862818.977381:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862818.977388:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526475776:0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.977414:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862818.977493:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526475648:0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.977528:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862818.977551:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787862818.977557:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526475520:0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.977591:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862818.977622:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526476032:0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.977646:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862818.978117:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475904 00000100:00100000:2.0:1787862818.978130:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475904 00000100:00100000:2.0:1787862818.978220:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475776 00000100:00100000:2.0:1787862818.978224:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475776 00000100:00100000:2.0:1787862818.978238:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476032 00000100:00100000:2.0:1787862818.978241:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476032 00000100:00100000:2.0:1787862818.978262:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787862818.978273:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526475904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862818.980490:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475392 00000100:00100000:1.0:1787862818.980523:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475392 00000100:00100000:1.0:1787862818.980610:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862818.980623:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526475392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862818.980694:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862818.985815:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526475904:12345-0@lo:400:kworker.0 Request processed in 7526us (8466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862818.985991:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787862818.986078:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862818.986110:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526475776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862818.986229:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526475776:12345-0@lo:400:kworker.0 Request processed in 131us (8813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862818.986237:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787862818.986255:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787862818.986264:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526476032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862818.986311:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526476032:12345-0@lo:400:kworker.0 Request processed in 49us (8665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862818.986318:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787862818.986358:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862818.986367:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862818.986813:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526475392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6189us (11219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862818.986827:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787862818.988761:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65115470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526475392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862818.989688:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475648 00000100:00100000:3.0:1787862818.989704:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475648 00000100:00100000:3.0:1787862818.989802:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787862818.989817:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526475648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.990018:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526475648:12345-0@lo:400:kworker.0 Request processed in 203us (12488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862818.991470:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787862818.993300:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526475776:0@lo:400:kworker.0 00000100:00100000:1.0:1787862818.993327:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526475904:0@lo:400:kworker.0 00000100:00100000:1.0:1787862818.993409:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526475520 00000100:00100000:1.0:1787862818.993420:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526475520 00000100:00100000:1.0:1787862818.993492:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787862818.993790:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862818.994697:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526476032:0@lo:400:kworker.0 00000100:00100000:3.0:1787862818.994721:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526475648:0@lo:400:kworker.0 00000100:00100000:1.0:1787862819.000012:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526475520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862819.000233:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526475520:12345-0@lo:400:kworker.0 Request processed in 4583us (22638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862819.000247:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787862819.000789:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526475520:0@lo:400:kworker.0 00010000:00010000:1.0:1787862819.167655:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862819.452549:0:17418:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862819.452563:0:17418:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862819.452614:0:17418:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787862819.452623:0:17418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862819.997168:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862819.997198:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526476160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862819.997302:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862819.998812:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476160 00000100:00100000:3.0:1787862819.998831:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476160 00000100:00100000:3.0:1787862819.998917:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787862819.998927:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65115470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526476160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862819.998976:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862819.999112:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65115470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526476160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862819.999121:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787862820.002556:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526476160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862820.188900:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862821.214415:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862821.535563:0:17470:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862821.535575:0:17470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862821.535622:0:17470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787862821.535629:0:17470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862822.237193:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862823.115491:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862823.115830:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063296 00000100:00100000:3.0:1787862823.115842:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063296 00000100:00100000:3.0:1787862823.115930:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00100000:3.0:1787862823.115942:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517063296:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862823.116071:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517063296:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 130us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862823.116079:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 72 00000100:00080000:2.0:1787862823.116405:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862823.119966:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862823.120016:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862823.120070:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063168 00000100:00100000:3.0:1787862823.120081:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063168 00000100:00100000:3.0:1787862823.120166:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 139 00000100:00100000:3.0:1787862823.120178:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517063168:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862823.120229:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063552 00000100:00100000:0.0:1787862823.120235:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063552 00000100:00100000:0.0:1787862823.120295:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:0.0:1787862823.120303:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517063552:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862823.120358:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517063552:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862823.120365:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00080000:2.0:1787862823.120516:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862823.120518:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517063168:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 340us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862823.120527:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 139 00000100:00100000:2.0:1787862823.138617:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862823.141674:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063424 00000100:00100000:0.0:1787862823.141690:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063424 00000100:00100000:0.0:1787862823.141774:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00100000:0.0:1787862823.141785:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517063424:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862823.141869:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517063424:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 87us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862823.141877:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 45 00000100:00080000:1.0:1787862823.141927:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862823.265242:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862823.648914:0:17521:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862823.648925:0:17521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862823.648975:0:17521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787862823.648982:0:17521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862824.092343:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862824.092380:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526476416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862824.092421:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526476544:0@lo:400:kworker.0 00000100:00100000:3.0:1787862824.092555:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862824.092601:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476416 00000100:00100000:1.0:1787862824.092611:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476416 00000100:00100000:3.0:1787862824.092621:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526476288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862824.092653:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862824.092678:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526476928:0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.092695:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787862824.092703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862824.092706:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526476416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862824.092721:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787862824.092727:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526476800:0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.092771:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526476416:12345-0@lo:400:kworker.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862824.092780:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787862824.092830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862824.092854:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476288 00000100:00100000:1.0:1787862824.092858:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476288 00000100:00100000:3.0:1787862824.092862:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526476416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862824.092994:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862824.093016:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526476672:0@lo:400:kworker.0 00000100:00100000:0.0:1787862824.093021:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526477056:0@lo:400:kworker.0 00000100:00100000:2.0:1787862824.093079:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862824.093085:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862824.093115:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476928 00000100:00100000:0.0:1787862824.093118:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476928 00000100:00100000:2.0:1787862824.094657:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476800 00000100:00100000:2.0:1787862824.094670:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476800 00000100:00100000:1.0:1787862824.094911:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787862824.094925:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526476288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862824.094964:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862824.095035:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526476288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862824.095056:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787862824.095083:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862824.095099:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862824.095112:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476544 00000100:00100000:1.0:1787862824.095116:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476544 00000100:00100000:1.0:1787862824.095151:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526476672 00000100:00100000:1.0:1787862824.095153:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526476672 00000100:00100000:1.0:1787862824.095168:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787862824.095174:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526476544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.095216:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526476544:12345-0@lo:400:kworker.0 Request processed in 42us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862824.095223:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787862824.095234:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787862824.095240:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526476672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.095284:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526476672:12345-0@lo:400:kworker.0 Request processed in 45us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862824.095301:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787862824.095321:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862824.096124:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526476544:0@lo:400:kworker.0 00000100:00100000:3.0:1787862824.096937:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477056 00000100:00100000:3.0:1787862824.096948:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477056 00000100:00080000:1.0:1787862824.097171:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862824.097230:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526476288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862824.097293:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862824.097942:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526476928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.098061:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526476928:12345-0@lo:400:kworker.0 Request processed in 106us (5336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862824.109298:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526476928:0@lo:400:kworker.0 00000100:00100000:0.0:1787862824.109591:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526476672:0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.116911:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787862824.116989:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862824.117013:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526476800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862824.117437:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526476800:0@lo:400:kworker.0 00000100:00100000:1.0:1787862824.119840:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526476800:12345-0@lo:400:kworker.0 Request processed in 2831us (26999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862824.119859:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787862824.134286:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787862824.134317:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526477056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862824.134858:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526477056:12345-0@lo:400:kworker.0 Request processed in 556us (41773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862824.134868:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862824.138734:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526477056:0@lo:400:kworker.0 00010000:00010000:0.0:1787862824.284584:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862824.732489:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862824.732501:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862824.732539:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862824.732546:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862825.116551:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526477184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862825.116634:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862825.116761:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477184 00000100:00100000:1.0:1787862825.116770:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477184 00000100:00100000:1.0:1787862825.116829:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787862825.116840:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526477184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862825.116888:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862825.117658:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526477184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 818us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862825.117670:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787862825.117771:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526477184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862825.317542:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862825.861015:0:17572:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862825.861026:0:17572:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862825.861091:0:17572:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862825.861098:0:17572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862826.332358:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862827.356300:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862827.832233:0:17624:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862827.832246:0:17624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862827.832297:0:17624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1787862827.832305:0:17624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862828.239876:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862828.243032:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063680 00000100:00100000:2.0:1787862828.243094:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063680 00000100:00100000:2.0:1787862828.243163:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:2.0:1787862828.243191:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517063680:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862828.243291:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517063680:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 104us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862828.243300:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 141 00000100:00100000:0.0:1787862828.243740:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862828.243788:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862828.243980:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862828.244065:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063808 00000100:00100000:3.0:1787862828.244071:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063808 00000100:00100000:3.0:1787862828.244123:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064064 00000100:00100000:3.0:1787862828.244126:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064064 00000100:00100000:3.0:1787862828.244147:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:3.0:1787862828.244154:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517063808:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862828.244227:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517063808:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 74us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862828.244234:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 77 00000100:00100000:3.0:1787862828.244249:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00100000:3.0:1787862828.244255:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517064064:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862828.244279:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517064064:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862828.244286:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 78 00000100:00080000:0.0:1787862828.244977:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862828.245749:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517063936 00000100:00100000:1.0:1787862828.245762:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517063936 00000100:00100000:1.0:1787862828.245894:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00100000:1.0:1787862828.245906:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517063936:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862828.245982:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517063936:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 79us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862828.245990:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 48 00000100:00080000:0.0:1787862828.246230:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862828.382359:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862829.212462:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526477568:0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.212563:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862829.212778:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787862829.212787:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526477696:0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.212825:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862829.212879:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477568 00000100:00100000:3.0:1787862829.212889:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477568 00000100:00100000:3.0:1787862829.212989:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787862829.213000:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526477568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.213279:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526477568:12345-0@lo:400:kworker.0 Request processed in 280us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862829.213287:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787862829.213314:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477696 00000100:00100000:3.0:1787862829.213318:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477696 00000100:00100000:3.0:1787862829.213362:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787862829.213370:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526477696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.213402:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526477696:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862829.213408:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1787862829.213426:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862829.213470:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526477696:0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.213481:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526477568:0@lo:400:kworker.0 00000100:00100000:2.0:1787862829.214341:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526477440:0@lo:400:kworker.0 00000100:00100000:2.0:1787862829.214401:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862829.214429:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526477952:0@lo:400:kworker.0 00000100:00100000:2.0:1787862829.214454:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862829.214475:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862829.214483:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526477312:0@lo:400:kworker.0 00000100:00100000:2.0:1787862829.214512:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862829.214552:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526477824:0@lo:400:kworker.0 00000100:00100000:2.0:1787862829.214576:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862829.214606:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477440 00000100:00100000:2.0:1787862829.214612:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477440 00000100:00100000:2.0:1787862829.214919:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787862829.214930:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526477440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.223253:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477312 00000100:00100000:3.0:1787862829.223274:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477312 00000100:00100000:3.0:1787862829.223341:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787862829.223353:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526477312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862829.224781:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526477440:12345-0@lo:400:kworker.0 Request processed in 9846us (10373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862829.224796:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787862829.225157:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477952 00000100:00100000:2.0:1787862829.225167:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477952 00000100:00100000:2.0:1787862829.225217:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526477824 00000100:00100000:2.0:1787862829.225220:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526477824 00000100:00100000:2.0:1787862829.225242:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787862829.225249:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526477952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862829.225825:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787862829.225842:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526478080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862829.225902:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862829.225947:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478080 00000100:00100000:0.0:1787862829.225951:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478080 00000100:00100000:0.0:1787862829.226000:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787862829.226008:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526478080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862829.226039:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862829.226099:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526478080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862829.226107:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787862829.226165:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65341492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526478080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787862829.226415:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862829.226422:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862829.226437:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787862829.226446:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526477824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862829.233078:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526477312:12345-0@lo:400:kworker.0 Request processed in 9711us (18548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862829.233099:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787862829.234791:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526477952:12345-0@lo:400:kworker.0 Request processed in 9530us (20323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862829.234806:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787862829.239975:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526477824:12345-0@lo:400:kworker.0 Request processed in 13509us (25377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862829.239993:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787862829.240098:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526477312:0@lo:400:kworker.0 00000100:00100000:0.0:1787862829.240121:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526477824:0@lo:400:kworker.0 00000100:00100000:0.0:1787862829.240136:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526477440:0@lo:400:kworker.0 00000100:00100000:0.0:1787862829.240148:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6401b3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526477952:0@lo:400:kworker.0 00010000:00010000:2.0:1787862829.404252:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862830.045101:0:17675:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862830.045198:0:17675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862830.045268:0:17675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862830.045275:0:17675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862830.236396:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526478208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862830.236489:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862830.236907:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478208 00000100:00100000:1.0:1787862830.236916:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478208 00000100:00100000:1.0:1787862830.237024:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787862830.237036:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526478208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862830.237118:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862830.237177:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401b3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526478208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862830.237196:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787862830.237310:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526478208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862830.428387:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862831.452272:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862832.089584:0:17726:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862832.089596:0:17726:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862832.089681:0:17726:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862832.089689:0:17726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862832.483227:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862833.353676:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862833.353849:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862833.353904:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862833.353954:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862833.353991:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064448 00000100:00100000:0.0:1787862833.354002:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064448 00000100:00100000:0.0:1787862833.354101:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00080000:3.0:1787862833.354105:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862833.354112:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517064448:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862833.354233:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517064448:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 122us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862833.354241:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 51 00000100:00100000:2.0:1787862833.354249:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064320 00000100:00100000:2.0:1787862833.354254:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064320 00000100:00080000:0.0:1787862833.354283:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862833.354285:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064576 00000100:00100000:2.0:1787862833.354288:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064576 00000100:00100000:0.0:1787862833.354299:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:0.0:1787862833.354306:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517064320:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862833.354311:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:2.0:1787862833.354317:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517064576:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862833.354339:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517064576:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 22us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862833.354346:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 83 00000100:00100000:1.0:1787862833.354642:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064192 00000100:00100000:1.0:1787862833.354647:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064192 00000100:00100000:1.0:1787862833.354687:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00100000:1.0:1787862833.354696:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517064192:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862833.354726:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517064192:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862833.354848:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00080000:1.0:1787862833.354898:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862833.355539:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517064320:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862833.355550:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00010000:00010000:2.0:1787862833.500580:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862834.081271:0:17778:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862834.081284:0:17778:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862834.081337:0:17778:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862834.081346:0:17778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862834.334244:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526478336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862834.334331:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862834.334892:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478336 00000100:00100000:1.0:1787862834.334901:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478336 00000100:00100000:1.0:1787862834.334968:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787862834.334989:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526478336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862834.335029:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862834.335127:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526478336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862834.335135:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787862834.335199:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526478336:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787862834.335323:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862834.335558:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526478592:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.335600:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862834.335636:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862834.335642:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526478720:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.335669:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862834.335701:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478720 00000100:00100000:2.0:1787862834.335705:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478720 00000100:00100000:2.0:1787862834.335740:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787862834.335747:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526478720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.335809:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526478720:12345-0@lo:400:kworker.0 Request processed in 62us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862834.335817:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787862834.335842:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526478464:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.335872:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862834.335897:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526478976:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.335918:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862834.335938:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862834.335944:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526478848:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.335965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862834.336004:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478976 00000100:00100000:2.0:1787862834.336009:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478976 00000100:00100000:2.0:1787862834.336035:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478848 00000100:00100000:2.0:1787862834.336064:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478848 00000100:00100000:2.0:1787862834.336088:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787862834.336095:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.336130:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526478976:12345-0@lo:400:kworker.0 Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862834.336138:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787862834.336164:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787862834.336171:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.336198:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526478848:12345-0@lo:400:kworker.0 Request processed in 29us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862834.336205:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787862834.336225:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862834.336251:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526478720:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.336284:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526478848:0@lo:400:kworker.0 00000100:00100000:2.0:1787862834.336294:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526478976:0@lo:400:kworker.0 00000100:00100000:3.0:1787862834.336515:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478464 00000100:00100000:3.0:1787862834.336520:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478464 00000100:00100000:3.0:1787862834.336554:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787862834.336562:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526478464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862834.336600:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526478464:12345-0@lo:400:kworker.0 Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862834.336606:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787862834.338553:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526478592 00000100:00100000:0.0:1787862834.338571:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526478592 00000100:00100000:0.0:1787862834.338628:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787862834.338638:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526478592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862834.338718:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526478592:12345-0@lo:400:kworker.0 Request processed in 82us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862834.338725:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787862834.338746:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862834.338782:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526478592:0@lo:400:kworker.0 00000100:00100000:3.0:1787862834.339272:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526478464:0@lo:400:kworker.0 00010000:00010000:0.0:1787862834.524927:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862834.972338:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862834.972350:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862834.972412:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862834.972420:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862835.366028:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862835.366070:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526479104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862835.366135:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862835.366212:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479104 00000100:00100000:2.0:1787862835.366220:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479104 00000100:00100000:2.0:1787862835.366265:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787862835.366273:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526479104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862835.366313:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862835.366352:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526479104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862835.366360:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787862835.366404:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526479104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862835.549132:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862836.145785:0:17829:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862836.145795:0:17829:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862836.145839:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787862836.145846:0:17829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862836.572617:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862837.596534:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862838.276566:0:17880:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862838.276576:0:17880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862838.276626:0:17880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1787862838.276632:0:17880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862838.478683:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862838.478746:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862838.478824:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862838.478854:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862838.478884:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064960 00000100:00100000:0.0:1787862838.478896:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064960 00000100:00100000:0.0:1787862838.478964:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:0.0:1787862838.478976:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517064960:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862838.479073:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517064960:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862838.479081:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 53 00000100:00100000:0.0:1787862838.479105:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064832 00000100:00100000:0.0:1787862838.479118:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064832 00000100:00100000:0.0:1787862838.479148:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065088 00000100:00100000:0.0:1787862838.479151:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065088 00000100:00100000:0.0:1787862838.479173:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:0.0:1787862838.479181:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517064832:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862838.479210:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517064832:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862838.479234:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 87 00000100:00100000:0.0:1787862838.479247:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:0.0:1787862838.479253:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517065088:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862838.479278:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517065088:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862838.479285:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00080000:0.0:1787862838.479305:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862838.479311:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862838.480926:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517064704 00000100:00100000:2.0:1787862838.480941:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517064704 00000100:00100000:2.0:1787862838.480992:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 145 00000100:00100000:2.0:1787862838.481002:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517064704:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862838.481084:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517064704:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 83us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862838.481092:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 145 00010000:00010000:0.0:1787862838.620707:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862839.452760:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526479232:0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.452965:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526479360:0@lo:400:kworker.0 00000100:00100000:3.0:1787862839.453022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862839.453022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862839.453552:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526479872:0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.453584:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862839.453611:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862839.453617:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526479488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.453645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862839.453679:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479360 00000100:00100000:1.0:1787862839.453686:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479360 00000100:00100000:1.0:1787862839.453736:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479488 00000100:00100000:1.0:1787862839.453740:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479488 00000100:00100000:1.0:1787862839.453764:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862839.453774:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526479360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.453902:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526479360:12345-0@lo:400:kworker.0 Request processed in 129us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862839.453909:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787862839.454077:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787862839.454086:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526479488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862839.454135:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526479488:12345-0@lo:400:kworker.0 Request processed in 51us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862839.454142:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787862839.454195:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862839.454199:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862839.454230:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526479488:0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.454258:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526479360:0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.454278:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862839.454286:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526480000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862839.454313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862839.454362:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480000 00000100:00100000:1.0:1787862839.454366:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480000 00000100:00100000:1.0:1787862839.454393:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787862839.454400:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526480000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862839.454438:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862839.454475:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526480000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862839.454482:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787862839.454513:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526480000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862839.454550:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479872 00000100:00100000:1.0:1787862839.454553:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479872 00000100:00100000:1.0:1787862839.454585:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787862839.454592:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.454627:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526479872:12345-0@lo:400:kworker.0 Request processed in 35us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862839.454634:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787862839.454647:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862839.454662:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526479872:0@lo:400:kworker.0 00000100:00100000:2.0:1787862839.455575:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526479616:0@lo:400:kworker.0 00000100:00100000:2.0:1787862839.455654:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862839.455707:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479232 00000100:00100000:2.0:1787862839.455713:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479232 00000100:00100000:2.0:1787862839.455746:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787862839.455753:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526479232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862839.455792:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526479232:12345-0@lo:400:kworker.0 Request processed in 40us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862839.455800:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787862839.456007:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479616 00000100:00100000:2.0:1787862839.456011:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479616 00000100:00100000:2.0:1787862839.456036:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787862839.456061:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526479616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862839.456098:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526479616:12345-0@lo:400:kworker.0 Request processed in 55us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862839.456115:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787862839.456190:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526479616:0@lo:400:kworker.0 00000100:00100000:3.0:1787862839.459265:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526479232:0@lo:400:kworker.0 00000100:00100000:3.0:1787862839.459596:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526479744:0@lo:400:kworker.0 00000100:00100000:3.0:1787862839.459729:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862839.464876:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526479744 00000100:00100000:1.0:1787862839.464894:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526479744 00000100:00100000:1.0:1787862839.464998:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787862839.465010:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526479744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862839.465159:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526479744:12345-0@lo:400:kworker.0 Request processed in 151us (5429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862839.465167:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1787862839.465370:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862839.465401:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526479744:0@lo:400:kworker.0 00010000:00010000:2.0:1787862839.644411:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862840.339371:0:17931:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862840.339381:0:17931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862840.339429:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862840.339437:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862840.478717:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862840.478740:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526480128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862840.478814:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862840.478881:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480128 00000100:00100000:3.0:1787862840.478889:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480128 00000100:00100000:3.0:1787862840.478950:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787862840.478961:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526480128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862840.478999:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862840.479464:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526480128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 504us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862840.479473:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787862840.479618:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526480128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862840.670526:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862841.692245:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862842.501139:0:17983:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862842.501150:0:17983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862842.501215:0:17983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1787862842.501223:0:17983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862842.716703:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862843.597247:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862843.597293:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862843.597382:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862843.597423:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862843.597456:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065344 00000100:00100000:0.0:1787862843.597467:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065344 00000100:00100000:0.0:1787862843.597528:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065600 00000100:00100000:0.0:1787862843.597532:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065600 00000100:00100000:0.0:1787862843.597572:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:0.0:1787862843.597598:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517065344:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862843.597684:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517065344:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862843.597692:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 92 00000100:00100000:0.0:1787862843.597726:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:0.0:1787862843.597734:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517065600:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862843.597772:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517065600:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862843.597779:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 93 00000100:00100000:2.0:1787862843.599303:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065216 00000100:00100000:2.0:1787862843.599315:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065216 00000100:00100000:2.0:1787862843.599373:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:2.0:1787862843.599382:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517065216:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862843.599456:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517065216:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 76us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862843.599463:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00080000:2.0:1787862843.599500:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862843.608157:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065472 00000100:00100000:1.0:1787862843.608174:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065472 00000100:00100000:1.0:1787862843.608332:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00100000:1.0:1787862843.608345:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517065472:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862843.608455:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517065472:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 113us (11161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862843.608464:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 56 00000100:00080000:2.0:1787862843.613176:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787862843.743901:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862844.189977:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862844.189989:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862844.191427:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:0.0:1787862844.191440:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1787862844.489488:0:18034:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862844.489508:0:18034:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862844.489558:0:18034:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:3.0:1787862844.489565:0:18034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862844.572500:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526480384:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.572580:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862844.572642:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526480896:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.572682:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862844.572712:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862844.572717:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526480512:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.572741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862844.572783:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480384 00000100:00100000:0.0:1787862844.572790:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480384 00000100:00100000:0.0:1787862844.572846:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480512 00000100:00100000:0.0:1787862844.572850:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480512 00000100:00100000:0.0:1787862844.572872:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787862844.572883:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526480384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.572947:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526480384:12345-0@lo:400:kworker.0 Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862844.572955:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787862844.572973:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787862844.572979:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.573008:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526480512:12345-0@lo:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862844.573014:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787862844.573033:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480896 00000100:00100000:0.0:1787862844.573037:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480896 00000100:00100000:0.0:1787862844.573360:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787862844.573368:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.573404:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526480896:12345-0@lo:400:kworker.0 Request processed in 36us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862844.573411:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787862844.573433:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862844.573438:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862844.573440:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862844.573477:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526480512:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.573490:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526480384:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.573499:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526480896:0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573584:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526480256:0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573622:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862844.573674:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526480768:0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573699:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862844.573721:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862844.573727:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526480640:0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573759:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862844.573786:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480768 00000100:00100000:3.0:1787862844.573791:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480768 00000100:00100000:3.0:1787862844.573817:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480640 00000100:00100000:3.0:1787862844.573820:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480640 00000100:00100000:3.0:1787862844.573836:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787862844.573841:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526480768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573877:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526480768:12345-0@lo:400:kworker.0 Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862844.573883:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787862844.573898:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787862844.573904:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526480640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573930:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526480640:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862844.573936:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787862844.573955:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862844.573975:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526480640:0@lo:400:kworker.0 00000100:00100000:3.0:1787862844.573985:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526480768:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.574821:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526480256 00000100:00100000:0.0:1787862844.574829:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526480256 00000100:00100000:0.0:1787862844.574870:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787862844.574878:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526480256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.574948:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526480256:12345-0@lo:400:kworker.0 Request processed in 71us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862844.574955:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787862844.575002:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526480256:0@lo:400:kworker.0 00000100:00100000:0.0:1787862844.582523:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862844.582551:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526481024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862844.582633:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862844.583543:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481024 00000100:00100000:1.0:1787862844.583553:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481024 00000100:00100000:1.0:1787862844.583602:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787862844.583612:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526481024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862844.583843:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862844.583915:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526481024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 304us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862844.583924:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787862844.583989:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526481024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862844.764355:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862845.598286:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862845.598323:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526481152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862845.598403:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862845.598707:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481152 00000100:00100000:3.0:1787862845.598728:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481152 00000100:00100000:3.0:1787862845.598787:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787862845.598798:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526481152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862845.598843:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862845.598950:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526481152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862845.598957:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787862845.602647:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526481152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862845.803867:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862846.682881:0:18085:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862846.682891:0:18085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862846.682931:0:18085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:1.0:1787862846.682944:0:18085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862846.821331:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862847.837288:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862848.714671:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862848.714731:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862848.714770:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862848.714800:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862848.714831:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065984 00000100:00100000:0.0:1787862848.714841:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065984 00000100:00100000:0.0:1787862848.714924:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:0.0:1787862848.714935:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517065984:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862848.715032:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517065984:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862848.715065:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 59 00000100:00100000:2.0:1787862848.715335:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065856 00000100:00100000:2.0:1787862848.715340:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065856 00000100:00100000:2.0:1787862848.715374:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066112 00000100:00100000:2.0:1787862848.715377:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066112 00000100:00100000:2.0:1787862848.715397:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:2.0:1787862848.715404:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517065856:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862848.715439:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517065856:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 36us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862848.715446:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:2.0:1787862848.715458:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:2.0:1787862848.715463:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517066112:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862848.715483:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517066112:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 20us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862848.715488:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 98 00000100:00100000:3.0:1787862848.715906:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517065728 00000100:00100000:3.0:1787862848.715911:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517065728 00000100:00100000:3.0:1787862848.715949:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 149 00000100:00100000:3.0:1787862848.715957:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517065728:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862848.715989:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517065728:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862848.715995:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 149 00000100:00080000:3.0:1787862848.716039:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862848.716072:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787862848.769275:0:18139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862848.769285:0:18139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862848.769330:0:18139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:3.0:1787862848.769338:0:18139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862848.864848:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862849.693852:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526481536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862849.693954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862849.694036:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862849.694071:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526481408:0@lo:400:kworker.0 00000100:00100000:2.0:1787862849.694097:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862849.694120:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526481920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862849.694152:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862849.694186:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481920 00000100:00100000:2.0:1787862849.694194:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481920 00000100:00100000:2.0:1787862849.694252:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787862849.694263:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526481920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787862849.694439:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862849.694765:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65346430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526481664:0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.694804:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862849.694826:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862849.694832:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534640b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526481280:0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.694855:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862849.694889:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526481792:0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.694913:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862849.694940:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481536 00000100:00100000:0.0:1787862849.694944:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481536 00000100:00100000:0.0:1787862849.694980:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481408 00000100:00100000:0.0:1787862849.694983:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481408 00000100:00100000:0.0:1787862849.695017:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787862849.695025:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526481536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.695105:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526481536:12345-0@lo:400:kworker.0 Request processed in 81us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862849.695113:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787862849.695129:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862849.695135:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526481408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.695164:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526481408:12345-0@lo:400:kworker.0 Request processed in 30us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862849.695169:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787862849.695186:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481664 00000100:00100000:0.0:1787862849.695190:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481664 00000100:00100000:0.0:1787862849.695202:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481792 00000100:00100000:0.0:1787862849.695204:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481792 00000100:00100000:0.0:1787862849.695215:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862849.695220:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526481664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.695250:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526481664:12345-0@lo:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862849.695256:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787862849.695266:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787862849.695271:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526481792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.695303:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526481792:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862849.695309:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787862849.695343:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526481280 00000100:00100000:0.0:1787862849.695346:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526481280 00000100:00100000:0.0:1787862849.695367:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787862849.695373:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526481280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.695400:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526481280:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862849.695406:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1787862849.695434:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862849.695437:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862849.695439:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862849.695474:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526481408:0@lo:400:kworker.0 00000100:00100000:0.0:1787862849.695487:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526481536:0@lo:400:kworker.0 00000100:00100000:3.0:1787862849.697088:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534640b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526481280:0@lo:400:kworker.0 00000100:00100000:3.0:1787862849.697112:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526481792:0@lo:400:kworker.0 00000100:00100000:3.0:1787862849.697124:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65346430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526481664:0@lo:400:kworker.0 00000100:00100000:2.0:1787862849.697601:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526481920:12345-0@lo:400:kworker.0 Request processed in 3338us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862849.697613:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787862849.697992:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526481920:0@lo:400:kworker.0 00000100:00100000:2.0:1787862849.703331:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526482048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862849.703413:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862849.703589:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482048 00000100:00100000:3.0:1787862849.703599:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482048 00000100:00100000:3.0:1787862849.703675:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787862849.703686:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526482048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862849.703729:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862849.703783:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526482048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862849.703791:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787862849.704027:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526482048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862849.885190:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862850.718656:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526482176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862850.718750:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862850.718926:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482176 00000100:00100000:3.0:1787862850.718935:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482176 00000100:00100000:3.0:1787862850.719010:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787862850.719021:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526482176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862850.719085:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862850.719130:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526482176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862850.719137:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787862850.719421:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526482176:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787862850.769407:0:18190:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862850.769418:0:18190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862850.769456:0:18190:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:2.0:1787862850.769463:0:18190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862850.910345:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862851.932465:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862852.684411:0:18241:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862852.684422:0:18241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862852.684465:0:18241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 2 00000040:00080000:2.0:1787862852.684472:0:18241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862852.956769:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862853.835609:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862853.835652:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862853.835695:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862853.835732:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862853.835763:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066368 00000100:00100000:0.0:1787862853.835772:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066368 00000100:00100000:3.0:1787862853.836011:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066624 00000100:00100000:3.0:1787862853.836015:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066624 00000100:00100000:1.0:1787862853.836077:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066496 00000100:00100000:1.0:1787862853.836083:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066496 00000100:00100000:3.0:1787862853.836090:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00100000:3.0:1787862853.836104:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517066624:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862853.836125:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:1.0:1787862853.836136:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517066496:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862853.836229:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:0.0:1787862853.836238:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517066368:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862853.836249:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066240 00000100:00100000:2.0:1787862853.836256:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066240 00000100:00100000:2.0:1787862853.836296:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 151 00000100:00100000:2.0:1787862853.836314:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517066240:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862853.836317:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517066624:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 215us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862853.836328:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 102 00000100:00080000:3.0:1787862853.836395:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862853.836401:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862853.842334:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517066496:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 6184us (6664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862853.842353:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 62 00000100:00100000:0.0:1787862853.843026:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517066368:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 6786us (7326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862853.843052:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:2.0:1787862853.847868:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517066240:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 11537us (12249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862853.847887:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 151 00010000:00010000:0.0:1787862853.984683:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862854.428301:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862854.428314:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862854.428698:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 1 00000040:00080000:0.0:1787862854.428707:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1787862854.647240:0:18292:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862854.647252:0:18292:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862854.649226:0:18292:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862854.649251:0:18292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862854.813528:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526482432:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.813645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862854.813711:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526482944:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.813737:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862854.813769:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787862854.813776:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526482560:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.814358:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862854.814399:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526483072:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.814429:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862854.814473:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482432 00000100:00100000:0.0:1787862854.814482:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482432 00000100:00100000:0.0:1787862854.814550:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482560 00000100:00100000:0.0:1787862854.814554:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482560 00000100:00100000:0.0:1787862854.814591:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862854.814601:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526482432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.814664:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526482432:12345-0@lo:400:kworker.0 Request processed in 65us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862854.814672:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787862854.814711:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862854.814717:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526482560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.814747:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526482560:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862854.814754:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787862854.814773:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482944 00000100:00100000:0.0:1787862854.814776:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482944 00000100:00100000:2.0:1787862854.815142:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526482816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862854.815185:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862854.816351:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526482304:0@lo:400:kworker.0 00000100:00100000:1.0:1787862854.816437:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862854.816501:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526482688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862854.816529:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862854.817940:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483072 00000100:00100000:0.0:1787862854.817954:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483072 00000100:00100000:2.0:1787862854.817995:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482688 00000100:00100000:2.0:1787862854.818001:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482688 00000100:00100000:0.0:1787862854.818007:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482816 00000100:00100000:0.0:1787862854.818010:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482816 00000100:00100000:0.0:1787862854.818024:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862854.818030:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787862854.818033:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526482944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862854.818036:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526482688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862854.818099:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862854.818169:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526482688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862854.818177:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787862854.818203:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862854.818210:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526483072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862854.818243:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526483072:12345-0@lo:400:kworker.0 Request processed in 33us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862854.818249:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862854.818263:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787862854.818268:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526482816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862854.818318:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526482816:12345-0@lo:400:kworker.0 Request processed in 50us (3132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862854.818325:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787862854.818341:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526482944:12345-0@lo:400:kworker.0 Request processed in 308us (4602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862854.818346:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862854.818366:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526482816:0@lo:400:kworker.0 00000100:00080000:0.0:1787862854.818372:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862854.818376:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862854.818378:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862854.818410:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526482560:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.818421:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526483072:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.818433:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526482432:0@lo:400:kworker.0 00000100:00100000:0.0:1787862854.818444:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526482944:0@lo:400:kworker.0 00000100:00100000:2.0:1787862854.818602:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526482688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862854.819403:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526482304 00000100:00100000:1.0:1787862854.819422:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526482304 00000100:00100000:1.0:1787862854.819512:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787862854.819523:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526482304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862854.819637:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526482304:12345-0@lo:400:kworker.0 Request processed in 116us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862854.819647:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787862854.819726:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526482304:0@lo:400:kworker.0 00010000:00010000:1.0:1787862855.014530:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862855.836590:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526483200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862855.836717:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862855.836803:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483200 00000100:00100000:1.0:1787862855.836819:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483200 00000100:00100000:1.0:1787862855.836896:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862855.836909:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526483200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862855.837145:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862855.837741:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526483200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 832us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862855.837753:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787862855.837911:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526483200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862856.029627:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862856.663027:0:18344:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862856.663040:0:18344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862856.664495:0:18344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862856.664519:0:18344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862857.052454:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862858.087226:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862858.601873:0:18397:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862858.601887:0:18397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862858.606762:0:18397:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862858.606795:0:18397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862858.953982:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862858.956445:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862858.956493:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862858.956540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862858.956580:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066880 00000100:00100000:0.0:1787862858.956594:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066880 00000100:00100000:0.0:1787862858.956674:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067136 00000100:00100000:0.0:1787862858.956678:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067136 00000100:00100000:0.0:1787862858.956704:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:0.0:1787862858.956715:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517066880:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862858.956827:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517066880:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862858.956836:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 107 00000100:00100000:0.0:1787862858.956857:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00100000:0.0:1787862858.956864:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517067136:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862858.956890:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517067136:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862858.956896:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 108 00000100:00080000:0.0:1787862858.956917:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862858.958003:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067008 00000100:00100000:3.0:1787862858.958020:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067008 00000100:00100000:3.0:1787862858.958114:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00100000:3.0:1787862858.958126:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517067008:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862858.958195:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517067008:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 73us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862858.958202:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 65 00000100:00080000:3.0:1787862858.958226:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862858.964391:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517066752 00000100:00100000:1.0:1787862858.964420:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517066752 00000100:00100000:1.0:1787862858.964530:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 153 00000100:00100000:1.0:1787862858.964544:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517066752:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862858.964688:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517066752:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 146us (10718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862858.964697:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 153 00010000:00010000:1.0:1787862859.100771:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862859.932411:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526483712:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.932510:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862859.932613:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862859.932640:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526483328:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.932678:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862859.932704:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526483840:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.932726:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862859.932756:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526483456:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.932787:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862859.932805:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526483968:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.932844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862859.932865:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862859.932871:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653aa452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526483584:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.932896:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862859.932964:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483712 00000100:00100000:0.0:1787862859.932974:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483712 00000100:00100000:0.0:1787862859.933025:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483840 00000100:00100000:0.0:1787862859.933029:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483840 00000100:00100000:0.0:1787862859.933082:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483968 00000100:00100000:0.0:1787862859.933085:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483968 00000100:00100000:0.0:1787862859.933105:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787862859.933115:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526483712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933177:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526483712:12345-0@lo:400:kworker.0 Request processed in 62us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862859.933184:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787862859.933204:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787862859.933211:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526483840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933239:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526483840:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862859.933245:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787862859.933264:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787862859.933284:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526483968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933319:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526483968:12345-0@lo:400:kworker.0 Request processed in 49us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862859.933326:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787862859.933344:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483456 00000100:00100000:0.0:1787862859.933347:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483456 00000100:00100000:0.0:1787862859.933370:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483584 00000100:00100000:0.0:1787862859.933372:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483584 00000100:00100000:0.0:1787862859.933387:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862859.933392:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526483456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933422:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526483456:12345-0@lo:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862859.933428:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787862859.933439:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787862859.933444:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526483584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933468:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526483584:12345-0@lo:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862859.933473:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787862859.933519:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526483584:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933530:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526483456:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933538:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526483968:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933589:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526483840:0@lo:400:kworker.0 00000100:00100000:0.0:1787862859.933599:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526483712:0@lo:400:kworker.0 00000100:00100000:2.0:1787862859.935075:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526484096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862859.935142:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862859.935296:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526483328 00000100:00100000:3.0:1787862859.935310:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526483328 00000100:00100000:3.0:1787862859.935386:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787862859.935396:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526483328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862859.935484:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526483328:12345-0@lo:400:kworker.0 Request processed in 90us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862859.935492:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787862859.935523:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862859.935528:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862859.935531:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862859.935566:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653aa46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526483328:0@lo:400:kworker.0 00000100:00100000:3.0:1787862859.935617:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484096 00000100:00100000:3.0:1787862859.935621:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484096 00000100:00100000:3.0:1787862859.935644:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787862859.935649:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526484096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862859.935690:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862859.952744:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526484096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17083us (17591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862859.952763:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787862859.955271:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526484096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862860.125252:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862860.566373:0:18448:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862860.566387:0:18448:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862860.566840:0:18448:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862860.566854:0:18448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862860.956361:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526484224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862860.956435:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862860.956658:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484224 00000100:00100000:1.0:1787862860.956667:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484224 00000100:00100000:1.0:1787862860.956729:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787862860.956739:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526484224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862860.956779:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862860.960611:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526484224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3862us (4164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862860.960627:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787862860.961624:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526484224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862861.148394:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862862.211453:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862862.603404:0:18501:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862862.603416:0:18501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862862.605023:0:18501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862862.606138:0:18501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862863.260315:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862864.078448:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862864.078506:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862864.078545:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862864.078585:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067520 00000100:00100000:0.0:1787862864.078597:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067520 00000100:00100000:1.0:1787862864.078600:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862864.078634:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067392 00000100:00100000:1.0:1787862864.078639:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067392 00000100:00100000:0.0:1787862864.078681:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00100000:1.0:1787862864.078682:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067648 00000100:00100000:1.0:1787862864.078686:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067648 00000100:00100000:0.0:1787862864.078698:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517067520:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862864.078732:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:1.0:1787862864.078743:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517067392:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862864.078796:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517067392:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 56us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862864.078804:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:2.0:1787862864.078821:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067264 00000100:00100000:2.0:1787862864.078827:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067264 00000100:00100000:1.0:1787862864.078828:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:1.0:1787862864.078840:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517067648:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862864.078869:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 155 00000100:00100000:2.0:1787862864.078894:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517067264:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862864.080972:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517067520:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 2262us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862864.080990:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 68 00000100:00080000:0.0:1787862864.081062:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862864.081069:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862864.082827:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517067648:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 3973us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862864.082846:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 113 00000100:00100000:2.0:1787862864.082983:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517067264:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 4092us (4549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862864.082996:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 155 00010000:00010000:0.0:1787862864.284237:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862864.641358:0:18552:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862864.641376:0:18552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862864.641938:0:18552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862864.641952:0:18552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:0.0:1787862864.674278:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862864.674290:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862864.674852:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862864.674864:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862865.055078:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526484352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862865.055182:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862865.055765:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526484480:0@lo:400:kworker.0 00000100:00100000:3.0:1787862865.055964:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862865.055993:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526484608:0@lo:400:kworker.0 00000100:00100000:2.0:1787862865.056039:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862865.056134:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526484992:0@lo:400:kworker.0 00000100:00100000:2.0:1787862865.056135:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484608 00000100:00100000:2.0:1787862865.056147:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484608 00000100:00100000:2.0:1787862865.056254:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787862865.056266:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526484608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862865.056330:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862865.056411:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526484608:12345-0@lo:400:kworker.0 Request processed in 144us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862865.056422:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787862865.056467:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526484736:0@lo:400:kworker.0 00000100:00100000:2.0:1787862865.056492:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526484608:0@lo:400:kworker.0 00000100:00100000:2.0:1787862865.056538:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526484864:0@lo:400:kworker.0 00000100:00100000:3.0:1787862865.056710:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862865.057117:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484352 00000100:00100000:0.0:1787862865.057125:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484352 00000100:00100000:0.0:1787862865.057189:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862865.057199:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526484352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862865.057235:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862865.057286:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526484352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862865.057314:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787862865.057339:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484480 00000100:00100000:0.0:1787862865.057343:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484480 00000100:00100000:0.0:1787862865.057371:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787862865.057378:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526484480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862865.057421:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526484480:12345-0@lo:400:kworker.0 Request processed in 44us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862865.057428:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1787862865.057456:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862865.057460:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862865.057472:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484992 00000100:00100000:0.0:1787862865.057476:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484992 00000100:00100000:0.0:1787862865.057506:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484736 00000100:00100000:0.0:1787862865.057509:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484736 00000100:00100000:0.0:1787862865.057527:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862865.057533:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526484992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862865.057580:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526484992:12345-0@lo:400:kworker.0 Request processed in 47us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862865.057586:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862865.057598:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787862865.057603:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526484736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862865.057637:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526484736:12345-0@lo:400:kworker.0 Request processed in 33us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862865.057643:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787862865.057669:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862865.057697:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526484736:0@lo:400:kworker.0 00000100:00100000:0.0:1787862865.057742:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526484480:0@lo:400:kworker.0 00000100:00100000:0.0:1787862865.057756:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526484992:0@lo:400:kworker.0 00000100:00100000:2.0:1787862865.059471:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862865.060256:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526484352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862865.063191:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526484864 00000100:00100000:1.0:1787862865.063214:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526484864 00000100:00100000:2.0:1787862865.064520:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787862865.064541:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526484864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862865.064680:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526484864:12345-0@lo:400:kworker.0 Request processed in 147us (5216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862865.064688:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1787862865.064723:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862865.065454:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526484864:0@lo:400:kworker.0 00010000:00010000:1.0:1787862865.308385:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862866.076348:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862866.076382:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526485120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862866.076478:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862866.076604:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485120 00000100:00100000:3.0:1787862866.076615:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485120 00000100:00100000:3.0:1787862866.076684:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787862866.076696:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526485120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862866.076746:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862866.076949:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526485120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862866.076968:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787862866.079595:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526485120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862866.334339:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862866.648315:0:18603:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862866.648328:0:18603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862866.648928:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862866.648943:0:18603:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862867.359925:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862868.380403:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862868.647532:0:18655:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862868.647548:0:18655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862868.648809:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862868.648841:0:18655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862869.198148:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862869.198225:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862869.198275:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862869.198306:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862869.198372:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067904 00000100:00100000:0.0:1787862869.198372:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517067776 00000100:00100000:1.0:1787862869.198382:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067904 00000100:00100000:0.0:1787862869.198382:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517067776 00000100:00100000:1.0:1787862869.198438:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068160 00000100:00100000:1.0:1787862869.198442:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068160 00000100:00100000:0.0:1787862869.198444:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 157 00000100:00100000:0.0:1787862869.198455:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517067776:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862869.198461:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00100000:1.0:1787862869.198468:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517067904:12345-192.168.202.60@tcp:400:kworker.0 00000100:00080000:2.0:1787862869.198570:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862869.198588:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:2.0:1787862869.198598:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517068160:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862869.198661:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068032 00000100:00100000:3.0:1787862869.198666:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068032 00000100:00100000:3.0:1787862869.198707:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 70 00000100:00100000:3.0:1787862869.198716:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d3f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517068032:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862869.199035:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517067776:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 579us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862869.199092:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 157 00000100:00100000:1.0:1787862869.199143:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517067904:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 674us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862869.199151:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 117 00000100:00080000:0.0:1787862869.199310:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862869.200585:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517068160:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 1979us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862869.200600:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:3.0:1787862869.202861:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d3f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517068032:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 4128us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862869.202887:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 70 00010000:00010000:1.0:1787862869.406767:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862870.173833:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526485504:0@lo:400:kworker.0 00000100:00100000:0.0:1787862870.174174:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526485248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862870.174233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862870.174444:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526485760:0@lo:400:kworker.0 00000100:00100000:0.0:1787862870.174478:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862870.175468:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787862870.175488:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526485376:0@lo:400:kworker.0 00000100:00100000:0.0:1787862870.175554:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862870.175598:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526485888:0@lo:400:kworker.0 00000100:00100000:0.0:1787862870.175630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862870.175679:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485248 00000100:00100000:0.0:1787862870.175689:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485248 00000100:00100000:0.0:1787862870.175761:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862870.175771:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526485248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862870.175830:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862870.175884:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526485248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862870.175892:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787862870.175934:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485376 00000100:00100000:0.0:1787862870.175938:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485376 00000100:00100000:0.0:1787862870.175965:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787862870.175973:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526485376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862870.176005:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526485376:12345-0@lo:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862870.176012:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787862870.176059:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862870.176094:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526485376:0@lo:400:kworker.0 00000100:00100000:0.0:1787862870.176118:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526485248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862870.176534:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862870.176578:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526486016:0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.176609:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862870.176633:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862870.176640:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526485632:0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.176661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862870.176956:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485760 00000100:00100000:1.0:1787862870.176962:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485760 00000100:00100000:1.0:1787862870.176999:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485888 00000100:00100000:1.0:1787862870.177003:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485888 00000100:00100000:1.0:1787862870.177026:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486016 00000100:00100000:1.0:1787862870.177029:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486016 00000100:00100000:1.0:1787862870.177069:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787862870.177077:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526485760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.177140:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526485760:12345-0@lo:400:kworker.0 Request processed in 64us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862870.177148:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787862870.177178:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787862870.177184:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526485888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.177216:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526485888:12345-0@lo:400:kworker.0 Request processed in 33us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862870.177222:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787862870.177234:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787862870.177240:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526486016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862870.179180:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485504 00000100:00100000:0.0:1787862870.179733:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526485632 00000100:00100000:0.0:1787862870.179748:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485632 00000100:00100000:0.0:1787862870.179838:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862870.179863:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526485632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862870.180026:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526485504 00000100:00100000:1.0:1787862870.180502:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526486016:12345-0@lo:400:kworker.0 Request processed in 3257us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862870.180586:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862870.180596:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526485504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862870.180646:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526485504:12345-0@lo:400:kworker.0 Request processed in 53us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862870.180655:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787862870.180977:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787862870.181541:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526485632:12345-0@lo:400:kworker.0 Request processed in 1678us (4876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862870.181549:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787862870.183475:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862870.183489:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862870.185660:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516829a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526485888:0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.185686:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526485760:0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.185746:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65168283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526485632:0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.185762:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526485504:0@lo:400:kworker.0 00000100:00100000:1.0:1787862870.185775:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526486016:0@lo:400:kworker.0 00010000:00010000:1.0:1787862870.431326:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862870.507698:0:18707:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862870.507713:0:18707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862870.508291:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862870.508305:0:18707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862871.197374:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526486144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862871.197897:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862871.198085:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486144 00000100:00100000:0.0:1787862871.198096:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486144 00000100:00100000:0.0:1787862871.198169:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787862871.198182:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526486144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862871.198235:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862871.198376:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526486144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862871.198383:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787862871.198981:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526486144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862871.453259:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862872.312982:0:18758:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862872.312998:0:18758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862872.313669:0:18758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862872.313749:0:18758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862872.479944:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862873.500778:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862874.219120:0:18809:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862874.219135:0:18809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862874.220192:0:18809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862874.220213:0:18809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862874.313212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862874.313276:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862874.313318:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862874.313353:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862874.313397:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068544 00000100:00100000:3.0:1787862874.313411:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068544 00000100:00100000:3.0:1787862874.313606:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:3.0:1787862874.313621:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517068544:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862874.313720:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517068544:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 102us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862874.313746:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 73 00000100:00100000:2.0:1787862874.314430:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068416 00000100:00100000:2.0:1787862874.314440:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068416 00000100:00100000:2.0:1787862874.314488:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068672 00000100:00100000:2.0:1787862874.314492:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068672 00000100:00100000:2.0:1787862874.314518:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:2.0:1787862874.314528:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517068416:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862874.314575:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2346:x1874709517068416:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 49us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862874.314581:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 122 00000100:00100000:2.0:1787862874.314595:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:2.0:1787862874.314601:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517068672:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862874.314621:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517068672:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 21us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862874.314627:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:0.0:1787862874.314832:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068288 00000100:00100000:0.0:1787862874.314837:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068288 00000100:00100000:0.0:1787862874.314878:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 159 00000100:00100000:0.0:1787862874.314884:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517068288:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862874.314911:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2346:x1874709517068288:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862874.314917:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 159 00000100:00080000:0.0:1787862874.314949:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862874.314955:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787862874.524210:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862874.908632:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862874.908650:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862874.909822:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862874.909845:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862875.292427:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526486272:0@lo:400:kworker.0 00000100:00100000:3.0:1787862875.292537:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862875.292563:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526486400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862875.292645:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862875.292919:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486272 00000100:00100000:2.0:1787862875.292929:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486272 00000100:00100000:2.0:1787862875.292988:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787862875.292998:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526486272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862875.293107:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526486272:12345-0@lo:400:kworker.0 Request processed in 110us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862875.293116:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787862875.293152:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862875.293163:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526486528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862875.293196:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862875.293522:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486528 00000100:00100000:1.0:1787862875.293528:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486528 00000100:00100000:1.0:1787862875.293573:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787862875.293581:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526486528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862875.293626:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862875.293660:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526486528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862875.293664:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787862875.293692:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862875.293734:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486400 00000100:00100000:3.0:1787862875.293749:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486400 00000100:00100000:3.0:1787862875.293864:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787862875.293884:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526486400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.293957:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526487040:0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.294966:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862875.295020:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862875.295031:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526486656:0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.295170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862875.295218:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526486784:0@lo:400:kworker.0 00000100:00100000:3.0:1787862875.295251:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526486400:12345-0@lo:400:kworker.0 Request processed in 1075us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862875.295269:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787862875.295305:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486656 00000100:00100000:3.0:1787862875.295312:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486656 00000100:00100000:3.0:1787862875.295360:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787862875.295368:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526486656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862875.295525:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526486656:12345-0@lo:400:kworker.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862875.295604:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787862875.295643:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862875.295738:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526486528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862875.295805:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487040 00000100:00100000:3.0:1787862875.295809:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487040 00000100:00100000:3.0:1787862875.295846:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787862875.295863:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526487040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862875.295902:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526487040:12345-0@lo:400:kworker.0 Request processed in 50us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862875.295929:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787862875.295945:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862875.295999:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526486912:0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.296829:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526486656:0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.296862:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526487040:0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.296948:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862875.296990:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526486272:0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.297026:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486784 00000100:00100000:0.0:1787862875.297031:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486784 00000100:00100000:0.0:1787862875.297566:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787862875.297577:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526486784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862875.297601:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862875.298324:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526486912 00000100:00100000:1.0:1787862875.298334:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526486912 00000100:00100000:1.0:1787862875.298389:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787862875.298889:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526486912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862875.299032:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526486784:12345-0@lo:400:kworker.0 Request processed in 1455us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862875.299120:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787862875.299187:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526486784:0@lo:400:kworker.0 00000100:00080000:0.0:1787862875.299778:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862875.302274:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526486400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862875.305621:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526486912:12345-0@lo:400:kworker.0 Request processed in 7211us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862875.306194:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787862875.306456:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526486912:0@lo:400:kworker.0 00010000:00010000:1.0:1787862875.548332:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862876.174727:0:18860:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862876.174740:0:18860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862876.175647:0:18860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862876.175660:0:18860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862876.316634:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526487168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862876.316699:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862876.316798:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487168 00000100:00100000:1.0:1787862876.316807:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487168 00000100:00100000:1.0:1787862876.316860:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787862876.316870:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526487168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862876.316909:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862876.317676:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526487168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 805us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862876.317697:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787862876.319361:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526487168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862876.572409:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862877.597105:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862878.038928:0:18912:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862878.038938:0:18912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862878.039733:0:18912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862878.039752:0:18912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862878.620292:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862879.435231:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862879.435266:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862879.435307:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862879.435332:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862879.435362:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068800 00000100:00100000:0.0:1787862879.435373:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068800 00000100:00100000:0.0:1787862879.435422:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 161 00000100:00100000:3.0:1787862879.435641:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517068928 00000100:00100000:3.0:1787862879.435645:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517068928 00000100:00100000:3.0:1787862879.435680:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069184 00000100:00100000:3.0:1787862879.435682:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069184 00000100:00100000:3.0:1787862879.435700:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:3.0:1787862879.435707:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517068928:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862879.435804:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517068928:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 97us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862879.435812:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:3.0:1787862879.435831:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 128 00000100:00100000:3.0:1787862879.435838:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517069184:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862879.435860:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517069184:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862879.435866:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 128 00000100:00100000:3.0:1787862879.435881:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069056 00000100:00100000:3.0:1787862879.435884:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069056 00000100:00100000:3.0:1787862879.435906:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:3.0:1787862879.435912:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517069056:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862879.435951:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517069056:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 39us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862879.435958:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 76 00000100:00100000:0.0:1787862879.437664:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517068800:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862879.437714:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517068800:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 2285us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862879.437719:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 161 00000100:00080000:0.0:1787862879.437782:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862879.437788:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787862879.644411:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862880.066507:0:18964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862880.066515:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862880.067090:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862880.067103:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862880.412441:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526487552:0@lo:400:kworker.0 00000100:00100000:0.0:1787862880.412525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862880.412598:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862880.412605:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526487680:0@lo:400:kworker.0 00000100:00100000:0.0:1787862880.412634:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862880.412668:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487552 00000100:00100000:0.0:1787862880.412675:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487552 00000100:00100000:0.0:1787862880.412760:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862880.412770:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526487552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862880.412825:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65168283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526487552:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862880.412833:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862880.412873:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487680 00000100:00100000:0.0:1787862880.412877:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487680 00000100:00100000:0.0:1787862880.412901:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787862880.412907:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526487680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862880.412937:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526487680:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862880.412943:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1787862880.412958:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862880.412988:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526487680:0@lo:400:kworker.0 00000100:00100000:0.0:1787862880.412999:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526487552:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413126:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526487424:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413156:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862880.413182:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526487936:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862880.413237:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787862880.413243:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526487296:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413270:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862880.413294:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526487808:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862880.413387:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487936 00000100:00100000:2.0:1787862880.413391:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487936 00000100:00100000:2.0:1787862880.413417:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487808 00000100:00100000:2.0:1787862880.413420:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487808 00000100:00100000:2.0:1787862880.413439:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787862880.413445:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526487936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413492:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526487936:12345-0@lo:400:kworker.0 Request processed in 47us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862880.413499:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787862880.413515:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787862880.413521:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526487808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413548:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526487808:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862880.413555:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787862880.413572:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487296 00000100:00100000:2.0:1787862880.413576:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487296 00000100:00100000:2.0:1787862880.413596:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787862880.413602:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526487296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413630:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526487296:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862880.413636:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787862880.413658:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862880.413667:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526488064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862880.413691:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862880.413891:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526487296:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413903:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526487808:0@lo:400:kworker.0 00000100:00100000:2.0:1787862880.413911:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526487936:0@lo:400:kworker.0 00000100:00100000:1.0:1787862880.414435:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488064 00000100:00100000:1.0:1787862880.414441:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488064 00000100:00100000:1.0:1787862880.414475:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862880.414483:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526488064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862880.414512:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862880.414563:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526488064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862880.414570:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787862880.414608:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526488064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862880.414651:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526487424 00000100:00100000:0.0:1787862880.414656:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526487424 00000100:00100000:0.0:1787862880.414688:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787862880.414695:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526487424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862880.414748:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526487424:12345-0@lo:400:kworker.0 Request processed in 53us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862880.414755:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787862880.415592:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862880.415598:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862880.415634:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526487424:0@lo:400:kworker.0 00010000:00010000:2.0:1787862880.668215:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862881.437280:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862881.437313:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526488192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862881.437394:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862881.439474:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488192 00000100:00100000:2.0:1787862881.439489:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488192 00000100:00100000:2.0:1787862881.439561:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787862881.439587:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526488192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862881.439630:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862881.439737:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526488192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862881.439745:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787862881.442397:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526488192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862881.701315:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862882.061139:0:19015:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862882.061158:0:19015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862882.061684:0:19015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862882.061697:0:19015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862882.717455:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862883.744060:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862884.125029:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862884.125065:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862884.125611:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862884.125625:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1787862884.140991:0:19067:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862884.141005:0:19067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862884.141675:0:19067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862884.141707:0:19067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862884.560033:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862884.560208:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862884.563289:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069440 00000100:00100000:1.0:1787862884.563311:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069440 00000100:00100000:1.0:1787862884.563440:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00100000:1.0:1787862884.563458:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517069440:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862884.563575:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517069440:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 124us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862884.563584:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 132 00000100:00080000:0.0:1787862884.563786:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862884.564218:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862884.564269:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862884.564342:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069568 00000100:00100000:3.0:1787862884.564350:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069568 00000100:00100000:3.0:1787862884.564416:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00100000:3.0:1787862884.564427:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517069568:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862884.564485:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2346:x1874709517069568:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862884.564493:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 79 00000100:00080000:0.0:1787862884.564604:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862884.566431:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069696 00000100:00100000:1.0:1787862884.566450:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069696 00000100:00080000:0.0:1787862884.566559:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862884.566577:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:1.0:1787862884.566618:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517069696:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862884.566750:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2346:x1874709517069696:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 135us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862884.566757:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:2.0:1787862884.572986:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069312 00000100:00100000:2.0:1787862884.573008:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069312 00000100:00100000:1.0:1787862884.573711:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 163 00000100:00100000:1.0:1787862884.573725:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517069312:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862884.573850:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517069312:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 126us (13832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862884.573859:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 163 00010000:00010000:2.0:1787862884.765395:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862885.533131:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526488320:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533242:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862885.533321:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526488832:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533356:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862885.533400:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862885.533407:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526488448:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533435:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862885.533454:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526488960:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533477:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862885.533514:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526488576:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862885.533559:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862885.533564:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526488704:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533610:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862885.533649:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488320 00000100:00100000:2.0:1787862885.533657:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488320 00000100:00100000:2.0:1787862885.533729:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787862885.533739:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526488320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533802:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526488320:12345-0@lo:400:kworker.0 Request processed in 64us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862885.533811:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787862885.533852:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488832 00000100:00100000:2.0:1787862885.533856:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488832 00000100:00100000:2.0:1787862885.533894:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488960 00000100:00100000:2.0:1787862885.533898:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488960 00000100:00100000:2.0:1787862885.533913:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488704 00000100:00100000:2.0:1787862885.533916:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488704 00000100:00100000:2.0:1787862885.533929:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787862885.533936:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526488832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.533972:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526488832:12345-0@lo:400:kworker.0 Request processed in 37us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862885.533979:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787862885.533990:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787862885.533997:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526488960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534025:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526488960:12345-0@lo:400:kworker.0 Request processed in 29us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862885.534031:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787862885.534071:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787862885.534078:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526488704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534118:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526488704:12345-0@lo:400:kworker.0 Request processed in 41us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862885.534134:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787862885.534158:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488448 00000100:00100000:2.0:1787862885.534162:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488448 00000100:00100000:2.0:1787862885.534190:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526488576 00000100:00100000:2.0:1787862885.534194:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526488576 00000100:00100000:2.0:1787862885.534216:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787862885.534223:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526488448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534260:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526488448:12345-0@lo:400:kworker.0 Request processed in 38us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862885.534267:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787862885.534280:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862885.534286:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526488576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534312:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526488576:12345-0@lo:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862885.534318:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787862885.534394:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526488704:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534407:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526488576:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534442:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526488448:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534452:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526488960:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534461:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526488320:0@lo:400:kworker.0 00000100:00100000:2.0:1787862885.534472:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526488832:0@lo:400:kworker.0 00000100:00080000:0.0:1787862885.535603:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862885.535613:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862885.535617:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862885.536364:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787862885.536392:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526489088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862885.536474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862885.536533:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489088 00000100:00100000:0.0:1787862885.536540:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489088 00000100:00100000:0.0:1787862885.536592:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787862885.536601:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526489088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862885.536647:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862885.536708:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526489088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862885.536716:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787862885.536771:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526489088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862885.788260:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862886.183527:0:19118:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862886.183542:0:19118:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862886.184156:0:19118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862886.184170:0:19118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862886.557005:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862886.557037:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526489216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862886.557292:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862886.557467:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489216 00000100:00100000:0.0:1787862886.557478:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489216 00000100:00100000:0.0:1787862886.557619:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787862886.557628:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526489216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862886.557689:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862886.557744:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526489216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862886.557752:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787862886.557845:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526489216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862886.813354:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862887.839007:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862888.243499:0:19169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862888.243508:0:19169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862888.246413:0:19169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862888.246431:0:19169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862888.860395:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862889.677178:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862889.677243:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862889.677282:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862889.677313:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862889.677360:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069952 00000100:00100000:3.0:1787862889.677372:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069952 00000100:00100000:3.0:1787862889.677433:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070208 00000100:00100000:3.0:1787862889.677436:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070208 00000100:00100000:3.0:1787862889.677460:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:3.0:1787862889.677470:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517069952:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862889.677566:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517069952:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862889.677574:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 137 00000100:00100000:3.0:1787862889.677592:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00100000:3.0:1787862889.677598:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517070208:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862889.677623:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517070208:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862889.677629:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 138 00000100:00080000:3.0:1787862889.677656:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862889.678738:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070080 00000100:00100000:0.0:1787862889.678749:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070080 00000100:00100000:0.0:1787862889.678830:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:0.0:1787862889.678839:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517070080:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862889.678890:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517070080:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 54us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862889.678898:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 82 00000100:00100000:2.0:1787862889.679124:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517069824 00000100:00100000:2.0:1787862889.679129:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517069824 00000100:00100000:2.0:1787862889.679177:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00100000:2.0:1787862889.679184:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517069824:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862889.679219:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517069824:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 36us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862889.679225:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 165 00000100:00080000:1.0:1787862889.679362:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862889.891983:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862890.230689:0:19220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862890.230703:0:19220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862890.231895:0:19220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862890.231911:0:19220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862890.652799:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526489472:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.652910:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862890.652969:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526489984:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.652994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862890.653016:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787862890.653022:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526489344:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653065:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862890.653084:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526489856:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653105:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862890.653129:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526489600:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653155:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862890.653173:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862890.653178:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526489728:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862890.653230:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489472 00000100:00100000:3.0:1787862890.653249:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489472 00000100:00100000:3.0:1787862890.653301:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489600 00000100:00100000:3.0:1787862890.653304:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489600 00000100:00100000:3.0:1787862890.653326:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787862890.653335:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526489472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653391:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526489472:12345-0@lo:400:kworker.0 Request processed in 57us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862890.653399:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787862890.653420:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862890.653426:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653457:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526489600:12345-0@lo:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862890.653464:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862890.653482:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489984 00000100:00100000:3.0:1787862890.653485:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489984 00000100:00100000:3.0:1787862890.653508:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489856 00000100:00100000:3.0:1787862890.653511:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489856 00000100:00100000:3.0:1787862890.653523:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489728 00000100:00100000:3.0:1787862890.653525:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489728 00000100:00100000:3.0:1787862890.653536:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787862890.653542:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526489984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653571:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526489984:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862890.653578:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787862890.653589:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787862890.653595:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526489856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653621:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526489856:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862890.653651:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787862890.653663:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787862890.653668:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526489728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.653699:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526489728:12345-0@lo:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862890.653705:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787862890.653735:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862890.653740:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862890.653742:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862890.653998:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526489728:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.654010:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526489600:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.654072:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526489856:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.654085:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526489472:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.654094:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526489984:0@lo:400:kworker.0 00000100:00100000:2.0:1787862890.654918:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526489344 00000100:00100000:2.0:1787862890.654929:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526489344 00000100:00100000:2.0:1787862890.654977:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787862890.654985:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526489344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862890.655072:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526489344:12345-0@lo:400:kworker.0 Request processed in 88us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862890.655080:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787862890.655160:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526489344:0@lo:400:kworker.0 00000100:00100000:3.0:1787862890.660591:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526490112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862890.660799:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862890.661545:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490112 00000100:00100000:0.0:1787862890.661556:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490112 00000100:00100000:0.0:1787862890.661677:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787862890.661697:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526490112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862890.661739:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862890.661809:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526490112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862890.662072:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526490112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862890.662484:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1787862890.908333:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862891.685136:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862891.685161:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526490240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862891.685247:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862891.685339:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490240 00000100:00100000:0.0:1787862891.685347:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490240 00000100:00100000:0.0:1787862891.685392:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787862891.685401:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526490240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862891.685437:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862891.685476:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526490240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862891.685484:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787862891.685530:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526490240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862891.933902:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862892.423532:0:19272:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862892.423541:0:19272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862892.435438:0:19272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862892.435459:0:19272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862892.956198:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862893.983418:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862894.329277:0:19323:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862894.329287:0:19323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862894.330402:0:19323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862894.330421:0:19323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1787862894.376579:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862894.376588:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862894.377183:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862894.377193:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862894.793814:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862894.793865:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862894.793915:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862894.794324:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070464 00000100:00100000:1.0:1787862894.794335:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070464 00000100:00100000:1.0:1787862894.794407:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070720 00000100:00100000:1.0:1787862894.794411:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070720 00000100:00100000:1.0:1787862894.794436:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 142 00000100:00100000:1.0:1787862894.794447:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517070464:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862894.794527:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517070464:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 81us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862894.794559:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 142 00000100:00100000:1.0:1787862894.794579:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00100000:1.0:1787862894.794596:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517070720:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862894.794624:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517070720:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 38us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862894.794631:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 143 00000100:00080000:0.0:1787862894.795090:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862894.797508:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070336 00000100:00100000:2.0:1787862894.797528:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070336 00000100:00100000:2.0:1787862894.797618:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:2.0:1787862894.797629:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517070336:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862894.797751:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517070336:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 123us (3834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862894.797759:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:0.0:1787862894.809872:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862894.810188:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070592 00000100:00100000:3.0:1787862894.810198:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070592 00000100:00100000:3.0:1787862894.810279:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00100000:3.0:1787862894.810303:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517070592:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862894.810391:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517070592:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 92us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862894.810400:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 85 00000100:00080000:0.0:1787862894.810464:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787862895.005196:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862895.772500:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526490368:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.772601:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862895.772654:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526490880:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.772683:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862895.772710:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862895.772715:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526490496:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.772763:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862895.772789:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526491008:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.772813:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862895.772842:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526490624:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.772868:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862895.772888:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862895.772893:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526490752:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.772914:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862895.772941:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490368 00000100:00100000:2.0:1787862895.772949:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490368 00000100:00100000:2.0:1787862895.772993:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787862895.773003:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526490368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.773080:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526490368:12345-0@lo:400:kworker.0 Request processed in 77us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862895.773088:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787862895.773137:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490496 00000100:00100000:2.0:1787862895.773141:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490496 00000100:00100000:2.0:1787862895.773182:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490624 00000100:00100000:2.0:1787862895.773185:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490624 00000100:00100000:2.0:1787862895.773206:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787862895.773213:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526490496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.773247:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526490496:12345-0@lo:400:kworker.0 Request processed in 36us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862895.773253:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787862895.773264:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787862895.773270:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526490624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774187:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862895.774204:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526491136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862895.774253:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862895.774361:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490880 00000100:00100000:1.0:1787862895.774367:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490880 00000100:00100000:1.0:1787862895.774403:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491008 00000100:00100000:1.0:1787862895.774407:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491008 00000100:00100000:1.0:1787862895.774421:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526490752 00000100:00100000:1.0:1787862895.774423:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526490752 00000100:00100000:1.0:1787862895.774436:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787862895.774444:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526490880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774497:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526490880:12345-0@lo:400:kworker.0 Request processed in 53us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862895.774504:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787862895.774523:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787862895.774529:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526491008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774560:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526491008:12345-0@lo:400:kworker.0 Request processed in 31us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862895.774566:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787862895.774610:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787862895.774616:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526490752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774649:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526490752:12345-0@lo:400:kworker.0 Request processed in 33us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862895.774655:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787862895.774682:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491136 00000100:00100000:1.0:1787862895.774685:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491136 00000100:00100000:1.0:1787862895.774712:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787862895.774719:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874709526491136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862895.774766:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526490752:0@lo:400:kworker.0 00000100:00080000:1.0:1787862895.774822:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862895.774827:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862895.774829:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862895.774863:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526490496:0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774876:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526491008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774886:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526490368:0@lo:400:kworker.0 00000100:00100000:1.0:1787862895.774897:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526490880:0@lo:400:kworker.0 00000100:00100000:2.0:1787862895.775850:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1874709526490624:12345-0@lo:400:kworker.0 Request processed in 2573us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862895.775861:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00002000:00000024:2.0:1787862895.775922:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862895.775972:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526491136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1253us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862895.775979:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787862895.776023:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526491136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862895.776072:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526490624:0@lo:400:kworker.0 00010000:00010000:0.0:1787862896.029368:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862896.369173:0:19374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862896.369183:0:19374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862896.369733:0:19374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862896.369745:0:19374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862896.797735:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526491264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862896.797852:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862896.798610:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491264 00000100:00100000:1.0:1787862896.798622:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491264 00000100:00100000:1.0:1787862896.798698:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787862896.798709:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526491264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862896.798766:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862896.800319:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526491264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1605us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862896.800334:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787862896.800515:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526491264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862897.052362:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862898.078375:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862898.390913:0:19426:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862898.390924:0:19426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862898.391542:0:19426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862898.391562:0:19426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862899.100253:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862899.919709:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862899.919768:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862899.919795:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862899.919821:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862899.919851:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071104 00000100:00100000:1.0:1787862899.919862:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071104 00000100:00100000:1.0:1787862899.919933:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:0.0:1787862899.919937:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070848 00000100:00100000:0.0:1787862899.919941:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070848 00000100:00100000:1.0:1787862899.919945:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517071104:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862899.919972:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 169 00000100:00100000:0.0:1787862899.919979:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517070848:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862899.920031:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517070848:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862899.920039:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 169 00000100:00100000:1.0:1787862899.926303:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517071104:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 6137us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862899.926331:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 88 00000100:00100000:1.0:1787862899.926394:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517070976 00000100:00100000:1.0:1787862899.926404:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517070976 00000100:00100000:1.0:1787862899.926455:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071232 00000100:00100000:1.0:1787862899.926459:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071232 00000100:00100000:1.0:1787862899.926482:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:1.0:1787862899.926491:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517070976:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862899.927127:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517070976:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 634us (7328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862899.927135:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 147 00000100:00100000:1.0:1787862899.927153:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00100000:1.0:1787862899.927162:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517071232:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862899.927198:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517071232:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 39us (7376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862899.927205:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 148 00000100:00080000:1.0:1787862899.927248:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862899.927253:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862900.124226:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862900.570470:0:19477:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862900.570489:0:19477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862900.570974:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862900.570985:0:19477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862900.892766:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526491392:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.893196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862900.893255:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862900.893261:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526491520:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.893291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862900.893326:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491520 00000100:00100000:2.0:1787862900.893333:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491520 00000100:00100000:2.0:1787862900.893391:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862900.893400:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.893456:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526491520:12345-0@lo:400:kworker.0 Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862900.893463:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862900.893510:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526491520:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.893561:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526491648:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.893585:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862900.893602:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862900.893607:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526491776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862900.893895:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491392 00000100:00100000:1.0:1787862900.893900:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491392 00000100:00100000:1.0:1787862900.893929:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787862900.893936:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526491392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862900.893972:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526491392:12345-0@lo:400:kworker.0 Request processed in 36us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862900.893979:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1787862900.894007:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862900.894020:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491648 00000100:00100000:1.0:1787862900.894024:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491648 00000100:00100000:1.0:1787862900.894085:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787862900.894092:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526491648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862900.894125:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526491648:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862900.894132:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787862900.894391:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862900.894960:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787862900.895302:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862900.895354:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526491648:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.895384:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526492032:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.895416:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862900.895443:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862900.895450:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6533e36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526491904:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.895472:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862900.895501:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491776 00000100:00100000:2.0:1787862900.895507:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491776 00000100:00100000:2.0:1787862900.895582:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787862900.895591:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526491776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862900.895636:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862900.895681:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526491776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862900.895689:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787862900.895711:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492032 00000100:00100000:2.0:1787862900.895715:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492032 00000100:00100000:2.0:1787862900.895763:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526491904 00000100:00100000:2.0:1787862900.895766:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526491904 00000100:00100000:2.0:1787862900.895787:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787862900.895794:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526492032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.895832:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526492032:12345-0@lo:400:kworker.0 Request processed in 39us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862900.895838:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787862900.895850:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787862900.895856:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526491904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.897689:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526491904:12345-0@lo:400:kworker.0 Request processed in 1825us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862900.897703:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787862900.897983:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862900.898070:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6533e36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526491904:0@lo:400:kworker.0 00000100:00100000:0.0:1787862900.898175:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526491776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862900.898256:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651feab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526492032:0@lo:400:kworker.0 00000100:00100000:2.0:1787862900.898307:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526491392:0@lo:400:kworker.0 00000100:00100000:1.0:1787862900.905791:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526492160:0@lo:400:kworker.0 00000100:00100000:1.0:1787862900.906597:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862900.906763:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492160 00000100:00100000:3.0:1787862900.906774:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492160 00000100:00100000:3.0:1787862900.906859:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787862900.906879:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526492160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862900.906952:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526492160:12345-0@lo:400:kworker.0 Request processed in 76us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862900.906960:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787862900.907012:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526492160:0@lo:400:kworker.0 00000100:00080000:1.0:1787862900.907468:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787862901.148384:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862901.918828:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526492288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862901.918915:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862901.919997:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492288 00000100:00100000:2.0:1787862901.920012:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492288 00000100:00100000:2.0:1787862901.920092:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787862901.920104:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526492288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862901.920147:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862901.920401:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526492288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 299us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862901.920409:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787862901.921071:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526492288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862902.173078:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862902.850481:0:19528:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862902.850492:0:19528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862902.851006:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862902.851018:0:19528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862903.196226:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862904.220595:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862904.607355:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862904.607363:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862904.608508:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862904.608526:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862905.040602:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862905.040664:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862905.040741:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071488 00000100:00100000:2.0:1787862905.040755:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071488 00000100:00100000:2.0:1787862905.040831:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 152 00000100:00100000:2.0:1787862905.040842:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517071488:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862905.040942:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517071488:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862905.040951:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 152 00000100:00100000:3.0:1787862905.041032:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071360 00000100:00100000:3.0:1787862905.041037:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071360 00000100:00100000:3.0:1787862905.041097:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00100000:3.0:1787862905.041105:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517071360:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862905.041133:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517071360:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862905.041139:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 171 00000100:00080000:0.0:1787862905.042333:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862905.052735:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862905.052831:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862905.052865:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071744 00000100:00100000:3.0:1787862905.052877:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071744 00000100:00100000:3.0:1787862905.052945:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 153 00000100:00100000:3.0:1787862905.052957:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517071744:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862905.053067:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517071744:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862905.053075:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 153 00000100:00100000:3.0:1787862905.053102:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071616 00000100:00100000:3.0:1787862905.053106:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071616 00000100:00100000:3.0:1787862905.053135:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00100000:3.0:1787862905.053141:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517071616:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862905.053214:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517071616:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862905.053230:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 91 00000100:00080000:3.0:1787862905.053248:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787862905.053253:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787862905.109476:0:19579:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862905.109485:0:19579:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862905.111414:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862905.111434:0:19579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862905.245175:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862906.013561:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526492672:0@lo:400:kworker.0 00000100:00100000:2.0:1787862906.013638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862906.013708:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862906.013715:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526492800:0@lo:400:kworker.0 00000100:00100000:2.0:1787862906.013746:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862906.013776:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492672 00000100:00100000:2.0:1787862906.013783:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492672 00000100:00100000:2.0:1787862906.013842:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787862906.013853:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526492672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862906.013911:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526492672:12345-0@lo:400:kworker.0 Request processed in 60us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862906.013931:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787862906.013957:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492800 00000100:00100000:2.0:1787862906.013961:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492800 00000100:00100000:2.0:1787862906.013987:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787862906.013995:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526492800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862906.014029:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526492800:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862906.014036:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787862906.014115:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526492800:0@lo:400:kworker.0 00000100:00100000:2.0:1787862906.014125:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526492672:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.014436:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526492544:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.014470:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862906.014507:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526493056:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.014530:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862906.014548:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787862906.014554:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526492416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.014582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862906.014603:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526492928:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.014626:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862906.014723:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492416 00000100:00100000:1.0:1787862906.014728:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492416 00000100:00100000:1.0:1787862906.014766:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787862906.014773:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526492416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862906.014812:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526492416:12345-0@lo:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862906.014819:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1787862906.014971:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862906.014985:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492544 00000100:00100000:3.0:1787862906.014988:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492544 00000100:00100000:3.0:1787862906.015024:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787862906.015031:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526492544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862906.015091:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526492544:12345-0@lo:400:kworker.0 Request processed in 61us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862906.015097:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787862906.015116:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493056 00000100:00100000:3.0:1787862906.015120:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493056 00000100:00100000:3.0:1787862906.015143:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526492928 00000100:00100000:3.0:1787862906.015146:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526492928 00000100:00100000:3.0:1787862906.015166:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787862906.015173:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526493056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862906.015204:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526493056:12345-0@lo:400:kworker.0 Request processed in 32us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862906.015211:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787862906.015223:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787862906.015229:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526492928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862906.015254:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526492928:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862906.015260:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787862906.015281:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787862906.015284:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862906.015401:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526492416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.015416:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526492928:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.015436:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526492544:0@lo:400:kworker.0 00000100:00100000:0.0:1787862906.015446:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526493056:0@lo:400:kworker.0 00000100:00100000:1.0:1787862906.015909:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862906.015925:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526493184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862906.015970:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862906.016154:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493184 00000100:00100000:2.0:1787862906.016159:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493184 00000100:00100000:2.0:1787862906.016201:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787862906.016210:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526493184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862906.016245:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862906.016292:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526493184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862906.016298:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787862906.017017:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526493184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787862906.270199:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862907.037216:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862907.037249:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526493312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862907.037333:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862907.037406:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493312 00000100:00100000:3.0:1787862907.037414:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493312 00000100:00100000:3.0:1787862907.037468:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862907.037491:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526493312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862907.037533:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862907.037582:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526493312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862907.037589:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787862907.037652:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526493312:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787862907.252759:0:19631:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862907.252771:0:19631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862907.253556:0:19631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862907.253570:0:19631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862907.295446:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862908.316408:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862909.325815:0:19682:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862909.325824:0:19682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862909.326387:0:19682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862909.326399:0:19682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862909.341294:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862910.157958:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862910.158013:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862910.158117:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862910.158163:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862910.158210:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072000 00000100:00100000:2.0:1787862910.158220:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072000 00000100:00100000:2.0:1787862910.158283:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072256 00000100:00100000:2.0:1787862910.158287:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072256 00000100:00100000:2.0:1787862910.158314:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 157 00000100:00100000:2.0:1787862910.158324:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517072000:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862910.158419:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517072000:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 96us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862910.158427:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 157 00000100:00100000:2.0:1787862910.158461:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 158 00000100:00100000:2.0:1787862910.158469:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517072256:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862910.158497:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517072256:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862910.158505:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 158 00000100:00080000:0.0:1787862910.158507:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862910.158599:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517071872 00000100:00100000:1.0:1787862910.158604:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517071872 00000100:00100000:1.0:1787862910.158648:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:1.0:1787862910.158656:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517071872:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862910.158697:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517071872:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 43us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862910.158705:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:3.0:1787862910.158784:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072128 00000100:00100000:3.0:1787862910.158789:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072128 00000100:00100000:3.0:1787862910.158836:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00100000:3.0:1787862910.158845:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517072128:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862910.158875:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517072128:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862910.158882:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 94 00000100:00080000:1.0:1787862910.158939:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862910.365032:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862911.132431:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526493696:0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.132551:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862911.132623:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862911.132629:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526493824:0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.132657:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862911.132694:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493696 00000100:00100000:3.0:1787862911.132702:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493696 00000100:00100000:3.0:1787862911.132775:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787862911.132785:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526493696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.132836:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526493696:12345-0@lo:400:kworker.0 Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862911.132844:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1787862911.132868:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862911.133349:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526493696:0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133428:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526493440:0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133475:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862911.133513:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526493952:0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133540:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862911.133564:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862911.133570:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526493568:0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862911.133609:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526494080:0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862911.133670:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493824 00000100:00100000:2.0:1787862911.133675:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493824 00000100:00100000:2.0:1787862911.133705:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493952 00000100:00100000:2.0:1787862911.133709:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493952 00000100:00100000:2.0:1787862911.133726:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494080 00000100:00100000:2.0:1787862911.133729:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494080 00000100:00100000:2.0:1787862911.133745:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787862911.133753:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526493824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133792:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526493824:12345-0@lo:400:kworker.0 Request processed in 40us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862911.133799:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787862911.133813:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787862911.133819:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526493952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133850:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526493952:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862911.133855:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787862911.133866:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787862911.133872:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526494080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133897:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526494080:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862911.133902:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787862911.133933:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526494080:0@lo:400:kworker.0 00000100:00100000:2.0:1787862911.133942:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526493952:0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.135928:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493440 00000100:00100000:3.0:1787862911.135940:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493440 00000100:00100000:3.0:1787862911.135990:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787862911.136000:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526493440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.136108:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526493440:12345-0@lo:400:kworker.0 Request processed in 108us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862911.136115:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787862911.136152:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526493568 00000100:00100000:3.0:1787862911.136156:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526493568 00000100:00100000:3.0:1787862911.136189:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787862911.136195:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.136237:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526493568:12345-0@lo:400:kworker.0 Request processed in 43us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862911.136243:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787862911.136263:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862911.136268:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862911.136299:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526493568:0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.136309:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526493440:0@lo:400:kworker.0 00000100:00100000:3.0:1787862911.136347:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526494208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862911.136399:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862911.136432:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526493824:0@lo:400:kworker.0 00000100:00100000:1.0:1787862911.136882:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494208 00000100:00100000:1.0:1787862911.136887:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494208 00000100:00100000:1.0:1787862911.136923:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862911.136930:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526494208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862911.136964:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862911.137012:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526494208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862911.137029:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787862911.137094:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6518f0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526494208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862911.390598:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862911.470018:0:19733:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862911.470028:0:19733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862911.471125:0:19733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862911.471217:0:19733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862912.156457:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862912.156485:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526494336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862912.156581:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862912.156774:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494336 00000100:00100000:3.0:1787862912.156784:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494336 00000100:00100000:3.0:1787862912.156850:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787862912.156861:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526494336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787862912.156903:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862912.156956:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526494336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862912.156965:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787862912.157147:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526494336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862912.412968:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862913.440084:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862913.446818:0:19785:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862913.446832:0:19785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862913.447643:0:19785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862913.447656:0:19785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862914.460584:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862914.845460:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862914.845469:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862914.845971:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862914.845982:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862915.276242:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862915.276287:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862915.276317:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862915.276341:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862915.276368:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072640 00000100:00100000:2.0:1787862915.276378:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072640 00000100:00100000:2.0:1787862915.276449:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00100000:2.0:1787862915.276460:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517072640:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862915.276533:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533e36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517072640:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 75us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862915.276541:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 97 00000100:00080000:3.0:1787862915.276547:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862915.276565:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072512 00000100:00100000:2.0:1787862915.276569:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072512 00000100:00100000:2.0:1787862915.276610:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072768 00000100:00100000:2.0:1787862915.276613:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072768 00000100:00100000:2.0:1787862915.276635:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 162 00000100:00100000:2.0:1787862915.276642:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517072512:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862915.276671:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517072512:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862915.276677:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 162 00000100:00100000:2.0:1787862915.276689:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 163 00000100:00100000:2.0:1787862915.276695:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517072768:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862915.276731:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d9be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517072768:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862915.276737:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 163 00000100:00080000:3.0:1787862915.276856:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862915.277149:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072384 00000100:00100000:1.0:1787862915.277155:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072384 00000100:00100000:1.0:1787862915.277189:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 175 00000100:00100000:1.0:1787862915.277198:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517072384:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862915.277245:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517072384:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 47us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862915.277252:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 175 00010000:00010000:0.0:1787862915.492567:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862915.560357:0:19836:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862915.560368:0:19836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862915.561740:0:19836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862915.561757:0:19836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862916.255769:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862916.255813:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526494464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862916.255892:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862916.256700:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494464 00000100:00100000:2.0:1787862916.256714:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494464 00000100:00100000:2.0:1787862916.256787:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787862916.256797:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6533a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526494464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862916.256841:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862916.256905:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6533a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526494464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862916.256913:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787862916.257224:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862916.259626:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526494464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862916.264521:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526494720:0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.264564:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526494592:0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.264606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862916.264606:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862916.264685:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526494848:0@lo:400:kworker.0 00000100:00100000:0.0:1787862916.264761:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526494976:0@lo:400:kworker.0 00000100:00100000:2.0:1787862916.265418:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494720 00000100:00100000:2.0:1787862916.265429:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494720 00000100:00100000:2.0:1787862916.265512:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787862916.265522:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526494720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.268098:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526495104:0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.269603:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862916.269737:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494592 00000100:00100000:3.0:1787862916.269747:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494592 00000100:00100000:3.0:1787862916.269804:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787862916.269829:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526494592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.269903:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526494592:12345-0@lo:400:kworker.0 Request processed in 77us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862916.269913:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787862916.269970:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495104 00000100:00100000:3.0:1787862916.269974:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495104 00000100:00100000:3.0:1787862916.270018:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787862916.270025:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526495104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.270077:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526495104:12345-0@lo:400:kworker.0 Request processed in 53us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862916.270083:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787862916.270132:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526494592:0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.270154:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526495104:0@lo:400:kworker.0 00000100:00100000:1.0:1787862916.281481:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862916.281580:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494848 00000100:00100000:1.0:1787862916.281590:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494848 00000100:00100000:1.0:1787862916.281644:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787862916.281654:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526494848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862916.281719:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526494848:12345-0@lo:400:kworker.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862916.281726:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787862916.281770:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526494848:0@lo:400:kworker.0 00000100:00080000:1.0:1787862916.281831:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862916.281838:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862916.283194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862916.283543:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526494976 00000100:00100000:3.0:1787862916.283553:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526494976 00000100:00100000:3.0:1787862916.283620:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787862916.283630:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526494976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862916.283692:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526494976:12345-0@lo:400:kworker.0 Request processed in 63us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862916.283699:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787862916.283753:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862916.283817:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526494976:0@lo:400:kworker.0 00000100:00100000:2.0:1787862916.284434:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526494720:12345-0@lo:400:kworker.0 Request processed in 18910us (19824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862916.284453:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787862916.288715:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526494720:0@lo:400:kworker.0 00010000:00010000:1.0:1787862916.509325:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862917.276730:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862917.276893:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526495232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862917.280372:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862917.280689:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495232 00000100:00100000:0.0:1787862917.280700:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495232 00000100:00100000:0.0:1787862917.281711:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862917.281728:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526495232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862917.281772:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862917.284573:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526495232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2838us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862917.284590:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787862917.284759:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526495232:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787862917.503511:0:19887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862917.503521:0:19887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862917.504088:0:19887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862917.504100:0:19887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862917.532772:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862918.560190:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862919.580800:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862919.636113:0:19938:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862919.636123:0:19938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862919.636688:0:19938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862919.636699:0:19938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862920.394574:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862920.394648:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517072896 00000100:00100000:3.0:1787862920.394660:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517072896 00000100:00100000:3.0:1787862920.394743:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 177 00000100:00100000:3.0:1787862920.394756:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65095e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517072896:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862920.394865:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65095e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517072896:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862920.394874:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 177 00000100:00100000:0.0:1787862920.395008:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862920.395073:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862920.395439:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073024 00000100:00100000:3.0:1787862920.395444:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073024 00000100:00100000:3.0:1787862920.395491:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073280 00000100:00100000:3.0:1787862920.395494:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073280 00000100:00100000:3.0:1787862920.395521:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00100000:2.0:1787862920.395555:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 168 00000100:00100000:2.0:1787862920.395567:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517073280:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862920.395698:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517073280:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 133us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862920.395714:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 168 00000100:00100000:3.0:1787862920.395828:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517073024:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862920.395858:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517073024:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 332us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862920.395865:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 167 00000100:00080000:0.0:1787862920.395939:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862920.404095:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862920.404175:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073152 00000100:00100000:3.0:1787862920.404186:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073152 00000100:00100000:3.0:1787862920.404258:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00100000:3.0:1787862920.404270:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517073152:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862920.404361:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517073152:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862920.404369:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 99 00000100:00080000:0.0:1787862920.404785:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862920.606641:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862921.374143:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526495360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862921.374220:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862921.374302:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495360 00000100:00100000:0.0:1787862921.374311:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495360 00000100:00100000:0.0:1787862921.374381:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787862921.374392:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526495360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862921.374426:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862921.374472:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526495360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862921.374479:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787862921.374501:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862921.374547:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526495360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862921.376126:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526495488:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.376195:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862921.376230:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526496000:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.376255:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862921.376280:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862921.376286:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526495616:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.376325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862921.376367:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526495744:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.376417:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862921.376436:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862921.376441:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526495872:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.376462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862921.376491:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495488 00000100:00100000:2.0:1787862921.376497:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495488 00000100:00100000:2.0:1787862921.376750:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862921.376763:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526495488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.376814:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526495488:12345-0@lo:400:kworker.0 Request processed in 55us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862921.376821:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787862921.376853:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496000 00000100:00100000:2.0:1787862921.376857:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496000 00000100:00100000:2.0:1787862921.376956:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495744 00000100:00100000:2.0:1787862921.376960:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495744 00000100:00100000:1.0:1787862921.376968:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495872 00000100:00100000:1.0:1787862921.376972:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495872 00000100:00100000:2.0:1787862921.376978:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787862921.376990:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526496000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862921.376992:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787862921.376997:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526495744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.377025:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874709526496000:12345-0@lo:400:kworker.0 Request processed in 36us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862921.377029:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65341483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526495744:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862921.377032:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787862921.377034:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787862921.377063:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787862921.377069:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526495872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.377098:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526495872:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862921.377962:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787862921.377989:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526495616 00000100:00100000:2.0:1787862921.377995:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526495616 00000100:00100000:2.0:1787862921.378028:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787862921.378036:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526495616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.378107:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401a43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526495616:12345-0@lo:400:kworker.0 Request processed in 73us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862921.378113:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787862921.378233:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526495616:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.378247:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526495488:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.378258:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874709526496000:0@lo:400:kworker.0 00000100:00080000:2.0:1787862921.378287:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862921.378292:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862921.378380:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526495872:0@lo:400:kworker.0 00000100:00100000:2.0:1787862921.378397:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537f5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526495744:0@lo:400:kworker.0 00000040:00080000:1.0:1787862921.392140:0:19990:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862921.392150:0:19990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862921.394328:0:19990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862921.394355:0:19990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862921.631245:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862922.396597:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862922.396623:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526496128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862922.396699:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862922.396717:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496128 00000100:00100000:0.0:1787862922.396725:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496128 00000100:00100000:0.0:1787862922.396783:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787862922.396794:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526496128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862922.396835:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862922.396939:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526496128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862922.396961:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787862922.397275:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526496128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862922.654960:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862923.398894:0:20041:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862923.398913:0:20041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862923.399797:0:20041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862923.399810:0:20041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862923.678263:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862924.060371:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862924.060397:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862924.060932:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862924.060944:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862924.700270:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862925.440000:0:20092:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862925.440011:0:20092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862925.441868:0:20092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862925.441889:0:20092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862925.513868:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862925.513939:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862925.514030:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862925.514091:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862925.514117:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073408 00000100:00100000:1.0:1787862925.514127:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073408 00000100:00100000:1.0:1787862925.514179:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 179 00000100:00100000:1.0:1787862925.514188:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517073408:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862925.514258:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517073408:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862925.514265:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 179 00000100:00100000:1.0:1787862925.514322:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073664 00000100:00100000:1.0:1787862925.514326:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073664 00000100:00100000:1.0:1787862925.514364:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:1.0:1787862925.514371:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517073664:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862925.514397:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517073664:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862925.514403:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 101 00000100:00100000:0.0:1787862925.519326:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073536 00000100:00100000:0.0:1787862925.519344:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073536 00000100:00100000:0.0:1787862925.519423:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073792 00000100:00100000:0.0:1787862925.519427:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073792 00000100:00100000:0.0:1787862925.519606:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 172 00000100:00100000:0.0:1787862925.519620:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517073536:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862925.519708:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517073536:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 92us (5852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862925.519923:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:1.0:1787862925.519939:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517073792:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862925.519969:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517073792:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 33us (6030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862925.520180:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 173 00000100:00100000:0.0:1787862925.520258:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 172 00000100:00080000:2.0:1787862925.522544:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787862925.522555:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787862925.724221:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862926.493291:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526496256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862926.493392:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862926.493573:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496256 00000100:00100000:2.0:1787862926.493584:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496256 00000100:00100000:2.0:1787862926.493654:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862926.493666:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526496256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862926.493703:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787862926.494019:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862926.501447:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526496256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7770us (8042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862926.501470:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787862926.501556:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526496384:0@lo:400:kworker.0 00000100:00100000:2.0:1787862926.501638:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862926.501709:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496384 00000100:00100000:2.0:1787862926.501721:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496384 00000100:00100000:2.0:1787862926.501774:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787862926.501788:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65090bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526496384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862926.505420:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526496256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862926.508063:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65090bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526496384:12345-0@lo:400:kworker.0 Request processed in 6252us (6400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862926.508080:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787862926.508672:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526496384:0@lo:400:kworker.0 00000100:00100000:3.0:1787862926.510793:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526496640:0@lo:400:kworker.0 00000100:00100000:3.0:1787862926.510869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862926.511656:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526496768:0@lo:400:kworker.0 00000100:00100000:0.0:1787862926.511703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862926.513144:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526496512:0@lo:400:kworker.0 00000100:00100000:1.0:1787862926.513221:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862926.513509:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496640 00000100:00100000:3.0:1787862926.513520:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496640 00000100:00100000:3.0:1787862926.513572:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496768 00000100:00100000:3.0:1787862926.513593:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496768 00000100:00100000:0.0:1787862926.513714:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787862926.513730:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526496640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862926.513986:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526496640:12345-0@lo:400:kworker.0 Request processed in 260us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862926.513995:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787862926.514029:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862926.514039:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526496896:0@lo:400:kworker.0 00000100:00100000:0.0:1787862926.514097:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862926.514111:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496512 00000100:00100000:1.0:1787862926.514116:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496512 00000100:00100000:2.0:1787862926.514315:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526496896 00000100:00100000:2.0:1787862926.514320:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526496896 00000100:00100000:3.0:1787862926.514409:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787862926.514417:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526496768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862926.514464:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526496768:12345-0@lo:400:kworker.0 Request processed in 49us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862926.514470:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787862926.514519:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526496640:0@lo:400:kworker.0 00000100:00100000:0.0:1787862926.514610:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526496768:0@lo:400:kworker.0 00000100:00100000:1.0:1787862926.514822:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787862926.514833:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526496512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862926.514884:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526496512:12345-0@lo:400:kworker.0 Request processed in 55us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862926.514891:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787862926.514934:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526496512:0@lo:400:kworker.0 00000100:00080000:3.0:1787862926.524406:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862926.524417:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862926.529983:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787862926.529997:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526496896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862926.530129:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526496896:12345-0@lo:400:kworker.0 Request processed in 134us (16032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862926.530160:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787862926.530739:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526496896:0@lo:400:kworker.0 00010000:00010000:3.0:1787862926.748765:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862927.517975:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862927.518014:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526497024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787862927.518118:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862927.518205:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497024 00000100:00100000:1.0:1787862927.518212:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497024 00000100:00100000:1.0:1787862927.518265:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787862927.518276:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526497024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862927.518332:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862927.518382:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526497024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862927.518390:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787862927.518426:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526497024:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787862927.556681:0:20144:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862927.556690:0:20144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862927.557448:0:20144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862927.557464:0:20144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862927.780203:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862928.807814:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862929.820216:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862929.952429:0:20195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862929.952445:0:20195:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862929.952977:0:20195:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862929.952991:0:20195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862930.634809:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862930.634867:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862930.634899:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862930.635113:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074048 00000100:00100000:3.0:1787862930.635130:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074048 00000100:00100000:3.0:1787862930.635248:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 177 00000100:00100000:3.0:1787862930.635282:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517074048:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862930.635405:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517074048:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 146us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862930.635413:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 177 00000100:00080000:1.0:1787862930.635799:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862930.636292:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517073920 00000100:00100000:2.0:1787862930.636300:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517073920 00000100:00100000:2.0:1787862930.636348:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 181 00000100:00100000:2.0:1787862930.636356:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517073920:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862930.636406:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517073920:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 50us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862930.636414:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 181 00000100:00100000:0.0:1787862930.637100:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074176 00000100:00100000:0.0:1787862930.637109:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074176 00000100:00100000:0.0:1787862930.637182:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00100000:0.0:1787862930.637191:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517074176:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862930.637250:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517074176:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 61us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862930.637269:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 103 00000100:00080000:1.0:1787862930.637414:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862930.637658:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862930.638532:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074304 00000100:00100000:0.0:1787862930.638542:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074304 00000100:00100000:0.0:1787862930.638606:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 178 00000100:00100000:0.0:1787862930.638616:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517074304:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862930.638682:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517074304:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 68us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862930.638689:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 178 00000100:00080000:1.0:1787862930.638747:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862930.844655:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862931.612463:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526497536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.612586:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.612716:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787862931.612723:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526497152:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.612757:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.612784:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526497664:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.612808:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.612841:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497152 00000100:00100000:2.0:1787862931.612849:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497152 00000100:00100000:2.0:1787862931.612908:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787862931.612919:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526497152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.612997:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526497152:12345-0@lo:400:kworker.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862931.613018:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787862931.613368:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526497152:0@lo:400:kworker.0 00000100:00100000:3.0:1787862931.614573:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497536 00000100:00100000:3.0:1787862931.614585:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497536 00000100:00100000:3.0:1787862931.614663:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497664 00000100:00100000:3.0:1787862931.614667:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497664 00000100:00100000:3.0:1787862931.614718:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787862931.614729:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526497536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862931.614816:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526497536:12345-0@lo:400:kworker.0 Request processed in 89us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862931.614823:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787862931.614854:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787862931.614860:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526497664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862931.614890:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526497664:12345-0@lo:400:kworker.0 Request processed in 30us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862931.614896:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1787862931.614918:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862931.614976:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526497664:0@lo:400:kworker.0 00000100:00100000:3.0:1787862931.614991:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526497536:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616171:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526497408:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616271:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.616331:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862931.616340:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526497280:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616363:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.616384:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526497792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616411:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.616447:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497408 00000100:00100000:2.0:1787862931.616454:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497408 00000100:00100000:2.0:1787862931.616503:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497280 00000100:00100000:2.0:1787862931.616507:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497280 00000100:00100000:2.0:1787862931.616535:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862931.616543:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526497408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616609:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526497408:12345-0@lo:400:kworker.0 Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862931.616617:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787862931.616643:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862931.616650:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526497280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616679:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526497280:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862931.616696:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787862931.616747:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526497280:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.616759:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526497408:0@lo:400:kworker.0 00000100:00080000:3.0:1787862931.620012:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787862931.620031:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862931.620266:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497792 00000100:00100000:3.0:1787862931.620278:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497792 00000100:00100000:3.0:1787862931.620376:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787862931.620388:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526497792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862931.620501:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526497792:12345-0@lo:400:kworker.0 Request processed in 116us (4089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862931.620510:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:2.0:1787862931.620649:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862931.620717:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6537e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526497792:0@lo:400:kworker.0 00000100:00100000:2.0:1787862931.628491:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787862931.628538:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a65344ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526497920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862931.628670:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862931.628768:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526497920 00000100:00100000:2.0:1787862931.628779:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526497920 00000100:00100000:2.0:1787862931.628844:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787862931.628855:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526497920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787862931.628914:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862931.628984:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537e84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526497920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862931.628993:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787862931.630290:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a65344ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526497920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862931.869816:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862932.254860:0:20246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862932.254875:0:20246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862932.257848:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862932.257894:0:20246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862932.636875:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526498048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862932.636967:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862932.637410:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498048 00000100:00100000:1.0:1787862932.637421:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498048 00000100:00100000:1.0:1787862932.637500:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787862932.637514:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526498048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862932.637568:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862932.637611:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526498048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862932.637620:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787862932.637923:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6534641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526498048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862932.901735:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787862933.921472:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862934.303701:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862934.303715:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862934.304767:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862934.304786:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1787862934.532503:0:20298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862934.532514:0:20298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862934.533109:0:20298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862934.533124:0:20298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862934.940972:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862935.758223:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862935.758278:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862935.758454:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862935.758500:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862935.758550:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074560 00000100:00100000:3.0:1787862935.758579:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074560 00000100:00100000:3.0:1787862935.758654:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074816 00000100:00100000:3.0:1787862935.758657:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074816 00000100:00100000:3.0:1787862935.758681:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 182 00000100:00100000:3.0:1787862935.758690:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517074560:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862935.758789:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517074560:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 100us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862935.758797:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 182 00000100:00100000:3.0:1787862935.758816:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00100000:3.0:1787862935.758823:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517074816:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862935.758857:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6534641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517074816:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 34us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862935.758863:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00080000:3.0:1787862935.758897:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862935.760096:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074432 00000100:00100000:1.0:1787862935.760111:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074432 00000100:00100000:1.0:1787862935.760188:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00100000:1.0:1787862935.760199:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65063e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517074432:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862935.760268:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65063e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517074432:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 72us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862935.760289:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 183 00000100:00100000:2.0:1787862935.769597:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074688 00000100:00100000:2.0:1787862935.769615:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074688 00000100:00100000:2.0:1787862935.769769:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00100000:2.0:1787862935.769781:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65344c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517074688:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862935.769889:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65344c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517074688:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 110us (11609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862935.769917:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 106 00000100:00080000:0.0:1787862935.783001:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787862935.965317:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862936.735185:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862936.735230:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526498176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862936.735345:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862936.735434:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526498304:0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.735435:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526498560:0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.735478:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862936.735497:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862936.735507:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787862936.735515:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526498688:0@lo:400:kworker.0 00000100:00100000:1.0:1787862936.735538:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526498816:0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.735550:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862936.735576:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862936.735607:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787862936.735608:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498176 00000100:00100000:1.0:1787862936.735615:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526498432:0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.735618:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498176 00000100:00100000:1.0:1787862936.735645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862936.735668:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526498944:0@lo:400:kworker.0 00000100:00100000:1.0:1787862936.735700:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862936.735701:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787862936.735716:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526498176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862936.735744:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498304 00000100:00100000:1.0:1787862936.735750:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498304 00002000:00000024:2.0:1787862936.735765:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862936.735786:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787862936.735795:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526498304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862936.735845:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526498304:12345-0@lo:400:kworker.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862936.735854:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787862936.735896:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498688 00000100:00100000:2.0:1787862936.735900:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526498176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862936.735901:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498688 00000100:00100000:2.0:1787862936.735912:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787862936.735935:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498816 00000100:00100000:1.0:1787862936.735940:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498816 00000100:00100000:2.0:1787862936.735944:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498560 00000100:00100000:2.0:1787862936.735950:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498560 00000100:00100000:1.0:1787862936.735966:0:15473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498944 00000100:00100000:1.0:1787862936.735971:0:15473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498944 00000100:00100000:2.0:1787862936.735983:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526498432 00000100:00100000:2.0:1787862936.735988:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526498432 00000100:00100000:1.0:1787862936.735996:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787862936.736007:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526498688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.736022:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787862936.736031:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526498560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862936.736075:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526498688:12345-0@lo:400:kworker.0 Request processed in 71us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862936.736098:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787862936.736100:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526498560:12345-0@lo:400:kworker.0 Request processed in 68us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862936.736118:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787862936.736122:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787862936.736130:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526498816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.736144:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862936.736153:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526498432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862936.736171:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526498816:12345-0@lo:400:kworker.0 Request processed in 44us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862936.736178:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787862936.736194:0:15473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787862936.736208:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526498432:12345-0@lo:400:kworker.0 Request processed in 47us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862936.736216:0:15473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526498944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.736217:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787862936.736283:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526498688:0@lo:400:kworker.0 00000100:00080000:0.0:1787862936.736764:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862936.736772:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862936.736774:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862936.741726:0:15473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526498944:12345-0@lo:400:kworker.0 Request processed in 5500us (6004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862936.741746:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526498560:0@lo:400:kworker.0 00000100:00100000:2.0:1787862936.741785:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651faea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526498176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862936.742948:0:15473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787862936.743291:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526498432:0@lo:400:kworker.0 00000100:00100000:0.0:1787862936.743411:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526498944:0@lo:400:kworker.0 00000100:00100000:0.0:1787862936.743429:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526498304:0@lo:400:kworker.0 00000100:00100000:0.0:1787862936.743446:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526498816:0@lo:400:kworker.0 00010000:00010000:3.0:1787862936.989312:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862937.048936:0:20352:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862937.048954:0:20352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862937.049533:0:20352:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862937.049550:0:20352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862937.761523:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526499072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862937.761712:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862937.761872:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499072 00000100:00100000:0.0:1787862937.761886:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499072 00000100:00100000:0.0:1787862937.761956:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862937.761967:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526499072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862937.762069:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862937.762134:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526499072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862937.762157:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787862937.762241:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640319ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526499072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787862938.012353:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862939.044807:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787862939.352595:0:20403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787862939.352610:0:20403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787862939.355290:0:20403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1787862939.355324:0:20403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862940.063685:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862940.876412:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862940.876462:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862940.876506:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862940.876539:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862940.876584:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075072 00000100:00100000:2.0:1787862940.876599:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075072 00000100:00100000:0.0:1787862940.876646:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075200 00000100:00100000:0.0:1787862940.876673:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075200 00000100:00100000:2.0:1787862940.876693:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075328 00000100:00100000:2.0:1787862940.876698:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075328 00000100:00100000:0.0:1787862940.876733:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:2.0:1787862940.876739:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:2.0:1787862940.876755:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517075072:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862940.876755:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517075200:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862940.876924:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517074944 00000100:00100000:3.0:1787862940.876930:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517074944 00000100:00100000:3.0:1787862940.876967:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 185 00000100:00100000:3.0:1787862940.876975:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517074944:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862940.877515:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517075200:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 766us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862940.877525:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 109 00000100:00100000:2.0:1787862940.877745:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651faea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517075072:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 995us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862940.877755:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:2.0:1787862940.877778:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 188 00000100:00100000:2.0:1787862940.877787:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517075328:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862940.877826:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517075328:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 42us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862940.877833:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 188 00000100:00080000:2.0:1787862940.877860:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862940.877867:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862940.878718:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517074944:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 1738us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862940.878730:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 185 00010000:00010000:2.0:1787862941.086147:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862941.657299:0:20455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862941.657317:0:20455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862941.659480:0:20455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862941.659524:0:20455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862941.852587:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526499584:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.852660:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526499200:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.852785:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.852852:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526499712:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.852888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.852937:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526499456:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.852971:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.852997:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862941.853003:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526499328:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.853026:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.853071:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526499840:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.853097:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.853239:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499200 00000100:00100000:1.0:1787862941.853249:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499200 00000100:00100000:1.0:1787862941.853340:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787862941.853351:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526499200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.853420:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526499200:12345-0@lo:400:kworker.0 Request processed in 72us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862941.853430:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787862941.853483:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499712 00000100:00100000:1.0:1787862941.853487:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499712 00000100:00100000:1.0:1787862941.853530:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499840 00000100:00100000:1.0:1787862941.853533:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499840 00000100:00100000:1.0:1787862941.853558:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787862941.853564:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526499712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862941.853730:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.855277:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526499712:12345-0@lo:400:kworker.0 Request processed in 1704us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862941.855297:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787862941.855337:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499584 00000100:00100000:1.0:1787862941.855345:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499584 00000100:00100000:1.0:1787862941.855377:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787862941.855386:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526499840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.855463:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526499840:12345-0@lo:400:kworker.0 Request processed in 79us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862941.855470:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787862941.855480:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787862941.855485:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526499584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.855514:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526499584:12345-0@lo:400:kworker.0 Request processed in 29us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862941.855521:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787862941.855546:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499456 00000100:00100000:1.0:1787862941.855560:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499456 00000100:00100000:0.0:1787862941.856888:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862941.856937:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526499968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862941.857026:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862941.858018:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499328 00000100:00100000:1.0:1787862941.858034:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499328 00000100:00100000:1.0:1787862941.867426:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787862941.867465:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526499456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.867644:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526499456:12345-0@lo:400:kworker.0 Request processed in 198us (14670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862941.867653:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787862941.867682:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787862941.867691:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526499328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.867735:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526499328:12345-0@lo:400:kworker.0 Request processed in 47us (14708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862941.867741:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787862941.867782:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862941.867789:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862941.867794:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862941.868102:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526499328:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.868134:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526499840:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.868162:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526499456:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.868257:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526499200:0@lo:400:kworker.0 00000100:00100000:1.0:1787862941.868275:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526499712:0@lo:400:kworker.0 00000100:00100000:0.0:1787862941.868638:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526499584:0@lo:400:kworker.0 00000100:00100000:0.0:1787862941.868694:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526499968 00000100:00100000:0.0:1787862941.868704:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526499968 00000100:00100000:0.0:1787862941.868768:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787862941.868776:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526499968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862941.868831:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862941.869122:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526499968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (12095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862941.869129:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787862941.869190:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526499968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787862942.110008:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862942.877025:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526500096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862942.877195:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862942.877451:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500096 00000100:00100000:2.0:1787862942.877463:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500096 00000100:00100000:2.0:1787862942.877541:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787862942.877554:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526500096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862942.877614:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862942.887034:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526500096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9463us (9820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862942.887081:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787862942.894627:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6403198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526500096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862943.142816:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862944.132467:0:20507:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862944.132483:0:20507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862944.136689:0:20507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862944.136722:0:20507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862944.156750:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862944.541374:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862944.541396:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862944.542318:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862944.542339:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862945.182979:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862946.010629:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862946.010677:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862946.010701:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862946.010804:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862946.010861:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075584 00000100:00100000:1.0:1787862946.010874:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075584 00000100:00100000:1.0:1787862946.010954:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075840 00000100:00100000:1.0:1787862946.010958:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075840 00000100:00100000:1.0:1787862946.010986:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00100000:1.0:1787862946.010998:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517075584:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862946.011159:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6403198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517075584:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 162us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862946.011168:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 192 00000100:00100000:1.0:1787862946.011189:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:1.0:1787862946.011198:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517075840:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862946.011233:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517075840:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 37us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862946.011241:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:1.0:1787862946.011273:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075712 00000100:00100000:1.0:1787862946.011278:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075712 00000100:00100000:1.0:1787862946.011320:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00100000:1.0:1787862946.011330:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517075712:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862946.011362:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640319ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517075712:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862946.011392:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 112 00000100:00080000:1.0:1787862946.011413:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787862946.011419:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862946.011715:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075456 00000100:00100000:3.0:1787862946.011721:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075456 00000100:00100000:3.0:1787862946.011763:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 187 00000100:00100000:3.0:1787862946.011771:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517075456:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862946.011819:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517075456:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 49us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862946.011826:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 187 00010000:00010000:1.0:1787862946.206143:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862946.563702:0:20558:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862946.563718:0:20558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862946.564571:0:20558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862946.564589:0:20558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862946.973161:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526500608:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.973278:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862946.973375:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787862946.973383:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526500224:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.973434:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862946.973463:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526500736:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.973506:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862946.973536:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526500480:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.973565:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862946.973584:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787862946.973590:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526500352:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.973613:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862946.973629:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526500864:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.973649:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862946.973684:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500608 00000100:00100000:1.0:1787862946.973694:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500608 00000100:00100000:1.0:1787862946.973759:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500736 00000100:00100000:1.0:1787862946.973763:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500736 00000100:00100000:1.0:1787862946.973790:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500864 00000100:00100000:1.0:1787862946.973793:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500864 00000100:00100000:2.0:1787862946.974416:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64019f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526500992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862946.974465:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862946.974554:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787862946.974571:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526500608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862946.974645:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526500608:12345-0@lo:400:kworker.0 Request processed in 78us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862946.974654:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787862946.974678:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787862946.974685:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526500736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862946.974717:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874709526500736:12345-0@lo:400:kworker.0 Request processed in 33us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862946.974724:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787862946.974749:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500224 00000100:00100000:2.0:1787862946.974767:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500224 00000100:00100000:2.0:1787862946.974798:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787862946.974812:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526500224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862946.974846:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3281:x1874709526500224:12345-0@lo:400:kworker.0 Request processed in 36us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862946.974853:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787862946.974915:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3281:1874709526500224:0@lo:400:kworker.0 00000100:00100000:2.0:1787862946.974934:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874709526500736:0@lo:400:kworker.0 00000100:00100000:2.0:1787862946.974948:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526500608:0@lo:400:kworker.0 00000100:00080000:2.0:1787862946.975022:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787862946.975225:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500480 00000100:00100000:0.0:1787862946.975232:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500480 00000100:00100000:0.0:1787862946.975289:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500352 00000100:00100000:0.0:1787862946.975293:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500352 00000100:00100000:0.0:1787862946.975317:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787862946.975325:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526500480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862946.975381:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526500480:12345-0@lo:400:kworker.0 Request processed in 57us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862946.975387:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787862946.975400:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862946.975406:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526500352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862946.975436:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526500352:12345-0@lo:400:kworker.0 Request processed in 31us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862946.975443:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787862946.975467:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526500992 00000100:00100000:0.0:1787862946.975471:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526500992 00000100:00100000:0.0:1787862946.975497:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787862946.975504:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526500992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862946.975538:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862946.975575:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526500992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862946.975582:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787862946.975612:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787862946.975615:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862946.975644:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64019f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526500992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862946.975660:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526500352:0@lo:400:kworker.0 00000100:00100000:0.0:1787862946.975670:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526500480:0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.976776:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787862946.976923:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526500864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862946.977026:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526500864:12345-0@lo:400:kworker.0 Request processed in 113us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862946.977033:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787862946.977660:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526500864:0@lo:400:kworker.0 00010000:00010000:3.0:1787862947.229868:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862947.998346:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526501120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862947.998479:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862947.998698:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501120 00000100:00100000:1.0:1787862947.998711:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501120 00000100:00100000:1.0:1787862948.002006:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787862948.002068:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526501120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862948.002143:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862948.002281:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526501120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (3801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862948.002289:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787862948.003992:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526501120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862948.253643:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862948.669663:0:20610:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862948.669683:0:20610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862948.670626:0:20610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862948.670642:0:20610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862949.277002:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862950.305658:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862950.841372:0:20661:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862950.841392:0:20661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862950.841896:0:20661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862950.841914:0:20661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862951.119146:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862951.119201:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862951.119236:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862951.119271:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862951.119314:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076224 00000100:00100000:0.0:1787862951.119330:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076224 00000100:00100000:0.0:1787862951.119423:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:0.0:1787862951.119441:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517076224:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862951.119661:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517076224:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 224us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862951.119671:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 115 00000100:00100000:0.0:1787862951.119701:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076096 00000100:00100000:0.0:1787862951.119706:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076096 00000100:00100000:0.0:1787862951.119737:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076352 00000100:00100000:0.0:1787862951.119740:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076352 00000100:00100000:0.0:1787862951.120167:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:0.0:1787862951.120181:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517076096:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862951.120224:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517076096:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 48us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862951.120231:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:0.0:1787862951.120246:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 198 00000100:00100000:0.0:1787862951.120252:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517076352:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862951.120278:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517076352:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 26us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862951.120306:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 198 00000100:00080000:0.0:1787862951.120333:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862951.120339:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862951.121401:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517075968 00000100:00100000:3.0:1787862951.121415:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517075968 00000100:00100000:3.0:1787862951.128857:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 189 00000100:00100000:3.0:1787862951.128894:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517075968:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862951.129076:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517075968:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 186us (9936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862951.129086:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 189 00010000:00010000:3.0:1787862951.324598:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862952.092434:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526501376:0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.092581:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862952.092715:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526501248:0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.092773:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862952.092855:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526501760:0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.092890:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862952.092934:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862952.092942:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526501632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.092970:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862952.093015:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501248 00000100:00100000:2.0:1787862952.093024:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501248 00000100:00100000:2.0:1787862952.093145:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787862952.093158:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526501248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.093231:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526501248:12345-0@lo:400:kworker.0 Request processed in 75us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862952.093242:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787862952.093291:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501760 00000100:00100000:2.0:1787862952.093296:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501760 00000100:00100000:2.0:1787862952.093344:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501632 00000100:00100000:2.0:1787862952.093348:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501632 00000100:00100000:2.0:1787862952.093374:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787862952.093381:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526501760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.093422:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64019f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526501760:12345-0@lo:400:kworker.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862952.093457:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787862952.093472:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787862952.093478:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526501632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.093509:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651feaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526501632:12345-0@lo:400:kworker.0 Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862952.093516:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787862952.093552:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862952.093630:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526501632:0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.093643:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526501248:0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.093654:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526501760:0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.093875:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526501888:0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.093914:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862952.093948:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862952.093955:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526501504:0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.093984:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862952.094028:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501376 00000100:00100000:1.0:1787862952.094035:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501376 00000100:00100000:1.0:1787862952.094112:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501504 00000100:00100000:1.0:1787862952.094116:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501504 00000100:00100000:1.0:1787862952.094143:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787862952.094160:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526501376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.094208:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526501376:12345-0@lo:400:kworker.0 Request processed in 49us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862952.094215:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787862952.094232:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787862952.094239:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526501504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.094270:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526501504:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862952.094278:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787862952.094326:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526501504:0@lo:400:kworker.0 00000100:00100000:1.0:1787862952.094339:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526501376:0@lo:400:kworker.0 00000100:00080000:2.0:1787862952.094677:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862952.094682:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787862952.094694:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526501888 00000100:00100000:2.0:1787862952.094697:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526501888 00000100:00100000:2.0:1787862952.094747:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787862952.094756:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526501888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862952.094802:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526501888:12345-0@lo:400:kworker.0 Request processed in 48us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862952.094809:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1787862952.094930:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862952.097377:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526502016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862952.097475:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862952.101148:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502016 00000100:00100000:3.0:1787862952.101179:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502016 00000100:00100000:3.0:1787862952.101285:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787862952.101322:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526502016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787862952.101392:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862952.101519:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526502016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862952.101529:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787862952.102001:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526501888:0@lo:400:kworker.0 00000100:00100000:3.0:1787862952.104958:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526502016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862952.350367:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787862952.964414:0:20713:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862952.964432:0:20713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862952.967624:0:20713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862952.967654:0:20713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862953.121766:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526502144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862953.121895:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862953.123691:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502144 00000100:00100000:0.0:1787862953.123709:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502144 00000100:00100000:0.0:1787862953.123789:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787862953.123802:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526502144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862953.123860:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862953.124314:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526502144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 513us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862953.124323:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787862953.129671:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526502144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862953.373483:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862954.397486:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862954.788933:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862954.788947:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862954.790765:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862954.790792:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1787862955.197229:0:20764:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862955.197245:0:20764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862955.198013:0:20764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862955.198194:0:20764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862955.420441:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862956.234206:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862956.234325:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862956.234357:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862956.234406:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862956.234457:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076608 00000100:00100000:0.0:1787862956.234473:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076608 00000100:00100000:1.0:1787862956.234529:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076736 00000100:00100000:1.0:1787862956.234553:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076736 00000100:00100000:0.0:1787862956.234575:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076864 00000100:00100000:0.0:1787862956.234582:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076864 00000100:00100000:0.0:1787862956.234632:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 202 00000100:00100000:0.0:1787862956.234651:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517076608:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862956.234677:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:1.0:1787862956.234696:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517076736:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862956.234791:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517076608:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 143us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862956.234826:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517076736:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 133us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862956.234850:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 118 00000100:00100000:0.0:1787862956.236002:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 202 00000100:00100000:0.0:1787862956.236072:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00100000:0.0:1787862956.236090:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517076864:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862956.236191:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517076864:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 108us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862956.236198:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00080000:0.0:1787862956.236252:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862956.236260:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862956.236665:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076480 00000100:00100000:3.0:1787862956.236675:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076480 00000100:00100000:3.0:1787862956.240485:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 191 00000100:00100000:3.0:1787862956.240517:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653da80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517076480:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862956.240684:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653da80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517076480:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 179us (6500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862956.240694:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 191 00010000:00010000:1.0:1787862956.444707:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862957.212245:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526502400:0@lo:400:kworker.0 00000100:00100000:1.0:1787862957.212482:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862957.212500:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526502272:0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.212555:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862957.212566:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526502912:0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.212606:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526502784:0@lo:400:kworker.0 00000100:00100000:1.0:1787862957.212607:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862957.212646:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787862957.212648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862957.212656:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526502528:0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.212679:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862957.212688:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787862957.212705:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862957.212728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862957.212753:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502400 00000100:00100000:1.0:1787862957.212762:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502400 00000100:00100000:1.0:1787862957.212838:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502528 00000100:00100000:1.0:1787862957.212842:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502528 00000100:00100000:3.0:1787862957.212851:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502272 00000100:00100000:3.0:1787862957.212857:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502272 00000100:00100000:1.0:1787862957.212877:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787862957.212891:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526502400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.212901:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787862957.212912:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526502272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862957.212971:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526502400:12345-0@lo:400:kworker.0 Request processed in 81us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862957.212973:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526502272:12345-0@lo:400:kworker.0 Request processed in 63us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862957.212986:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787862957.212988:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787862957.213032:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787862957.213040:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526502528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.213076:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502912 00000100:00100000:3.0:1787862957.213082:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502912 00000100:00100000:3.0:1787862957.213121:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502784 00000100:00100000:3.0:1787862957.213124:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502784 00000100:00100000:3.0:1787862957.213143:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526502656 00000100:00100000:3.0:1787862957.213146:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526502656 00000100:00100000:3.0:1787862957.213163:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787862957.213170:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526502912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.213208:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526502912:12345-0@lo:400:kworker.0 Request processed in 40us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862957.213215:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787862957.213230:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787862957.213237:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526502784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.213271:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526502784:12345-0@lo:400:kworker.0 Request processed in 35us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862957.213289:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787862957.213304:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787862957.213310:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526502656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.213344:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651f8952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526502656:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862957.213572:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526502528:12345-0@lo:400:kworker.0 Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862957.213580:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787862957.214024:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862957.214033:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862957.214036:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862957.215990:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787862957.216228:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526503040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862957.217832:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862957.217898:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503040 00000100:00100000:1.0:1787862957.217910:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503040 00000100:00100000:1.0:1787862957.217984:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862957.217988:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787862957.217999:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653aa45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526503040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862957.218022:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526502272:0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.218039:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526502784:0@lo:400:kworker.0 00002000:00000024:1.0:1787862957.218091:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787862957.218124:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526502528:0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.218142:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526502400:0@lo:400:kworker.0 00000100:00100000:3.0:1787862957.218156:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526502912:0@lo:400:kworker.0 00000100:00100000:1.0:1787862957.218402:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653aa45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526503040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 406us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862957.218412:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787862957.219502:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526503040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787862957.474708:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862957.537688:0:20816:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862957.537704:0:20816:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862957.541429:0:20816:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862957.541470:0:20816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862958.236518:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526503168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862958.236650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862958.237444:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503168 00000100:00100000:1.0:1787862958.237462:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503168 00000100:00100000:1.0:1787862958.237544:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787862958.237558:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526503168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787862958.237617:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862958.237724:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526503168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862958.237733:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787862958.237961:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526503168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862958.495324:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862959.521387:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862959.627228:0:20867:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862959.627245:0:20867:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862959.629100:0:20867:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862959.629122:0:20867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862960.540368:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862961.357414:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862961.357456:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862961.357483:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862961.357513:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517076992 00000100:00100000:1.0:1787862961.357523:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517076992 00000100:00100000:1.0:1787862961.357574:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:1.0:1787862961.357584:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517076992:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862961.357663:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517076992:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862961.357682:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 193 00000100:00100000:1.0:1787862961.357726:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077120 00000100:00100000:1.0:1787862961.357730:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077120 00000100:00100000:1.0:1787862961.357771:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077376 00000100:00100000:1.0:1787862961.357774:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077376 00000100:00100000:1.0:1787862961.357794:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:1.0:1787862961.357801:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517077120:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862961.357831:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517077120:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862961.357837:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 207 00000100:00100000:1.0:1787862961.357848:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 208 00000100:00100000:1.0:1787862961.357854:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517077376:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862961.357874:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517077376:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 20us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862961.357881:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 208 00000100:00080000:1.0:1787862961.358065:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862961.370271:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862961.370364:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077248 00000100:00100000:2.0:1787862961.370375:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077248 00000100:00100000:2.0:1787862961.370492:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00100000:2.0:1787862961.370506:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517077248:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862961.370590:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517077248:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 88us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862961.370598:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 121 00000100:00080000:1.0:1787862961.370649:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787862961.488435:0:20918:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862961.488445:0:20918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862961.488994:0:20918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862961.489006:0:20918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787862961.564295:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862962.332568:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787862962.332595:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526503296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862962.332674:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862962.332755:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503296 00000100:00100000:1.0:1787862962.332764:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503296 00000100:00100000:1.0:1787862962.332827:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787862962.332835:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526503296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862962.332873:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862962.332942:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526503296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00080000:2.0:1787862962.332979:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862962.332984:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787862962.333075:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526503296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862962.333809:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526503552:0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.333826:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526503808:0@lo:400:kworker.0 00000100:00100000:2.0:1787862962.333858:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862962.333881:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862962.333903:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862962.333912:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526503424:0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.333915:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862962.333923:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526503680:0@lo:400:kworker.0 00000100:00100000:2.0:1787862962.333952:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862962.333982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862962.334001:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526503936:0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.334024:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503808 00000100:00100000:3.0:1787862962.334030:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503808 00000100:00100000:2.0:1787862962.334035:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862962.334102:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503680 00000100:00100000:3.0:1787862962.334106:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503680 00000100:00100000:2.0:1787862962.334115:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503936 00000100:00100000:2.0:1787862962.334120:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503936 00000100:00100000:3.0:1787862962.334128:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787862962.334138:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526503808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.334201:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526503808:12345-0@lo:400:kworker.0 Request processed in 65us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862962.334209:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787862962.334225:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787862962.334232:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526503680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.334258:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526503680:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862962.334264:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:3.0:1787862962.334279:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862962.334300:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526503680:0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.334309:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526503808:0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.334336:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503424 00000100:00100000:3.0:1787862962.334339:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503424 00000100:00100000:3.0:1787862962.334360:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787862962.334367:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526503424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862962.334415:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526503424:12345-0@lo:400:kworker.0 Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862962.334422:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787862962.334455:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526503424:0@lo:400:kworker.0 00000100:00100000:2.0:1787862962.335709:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787862962.335725:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526503936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862962.335880:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526503936:12345-0@lo:400:kworker.0 Request processed in 161us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862962.335890:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787862962.336071:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526503552 00000100:00100000:2.0:1787862962.336081:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526503552 00000100:00080000:3.0:1787862962.342636:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862962.343216:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526503936:0@lo:400:kworker.0 00000100:00100000:2.0:1787862962.353630:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787862962.353686:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526503552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862962.353865:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526503552:12345-0@lo:400:kworker.0 Request processed in 213us (20008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862962.353901:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787862962.354206:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526503552:0@lo:400:kworker.0 00010000:00010000:1.0:1787862962.588384:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862963.356382:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526504064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862963.356485:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862963.356582:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504064 00000100:00100000:2.0:1787862963.356591:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504064 00000100:00100000:2.0:1787862963.357145:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787862963.357156:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526504064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862963.357213:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862963.357319:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526504064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862963.357326:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787862963.358570:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526504064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862963.612630:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862963.875299:0:20970:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862963.875309:0:20970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862963.876019:0:20970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862963.876031:0:20970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787862964.636267:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862965.020333:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862965.020343:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862965.020866:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862965.020879:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862965.670454:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862966.125135:0:21021:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862966.125149:0:21021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862966.125654:0:21021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862966.125668:0:21021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862966.482661:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862966.482715:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862966.482765:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862966.482808:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862966.483300:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077760 00000100:00100000:1.0:1787862966.483313:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077760 00000100:00100000:1.0:1787862966.483414:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:1.0:1787862966.483430:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517077760:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862966.483530:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517077760:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 104us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862966.483539:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 123 00000100:00100000:1.0:1787862966.483566:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077632 00000100:00100000:1.0:1787862966.483571:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077632 00000100:00100000:1.0:1787862966.483602:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077888 00000100:00100000:1.0:1787862966.483606:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077888 00000100:00100000:1.0:1787862966.483627:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 212 00000100:00100000:1.0:1787862966.483634:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402add680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517077632:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862966.483664:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402add680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517077632:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862966.483683:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 212 00000100:00100000:1.0:1787862966.483697:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00100000:1.0:1787862966.483704:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402add2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517077888:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862966.483730:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402add2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517077888:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 27us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862966.483737:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 213 00000100:00080000:1.0:1787862966.483758:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862966.483763:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862966.485198:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517077504 00000100:00100000:2.0:1787862966.485210:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517077504 00000100:00100000:2.0:1787862966.485276:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 195 00000100:00100000:2.0:1787862966.485287:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517077504:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862966.485353:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517077504:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 69us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862966.485361:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 195 00010000:00010000:1.0:1787862966.684248:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862967.452473:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787862967.452511:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526504192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862967.452611:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862967.453108:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504192 00000100:00100000:1.0:1787862967.453117:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504192 00000100:00100000:1.0:1787862967.453179:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787862967.453189:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402aded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526504192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862967.453225:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862967.453272:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402aded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526504192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862967.453279:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787862967.453303:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862967.455619:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526504192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787862967.472104:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526504448:0@lo:400:kworker.0 00000100:00100000:0.0:1787862967.472220:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862967.472311:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787862967.472318:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526504576:0@lo:400:kworker.0 00000100:00100000:0.0:1787862967.472364:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862967.472439:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504576 00000100:00100000:0.0:1787862967.472449:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504576 00000100:00100000:0.0:1787862967.472512:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787862967.472523:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526504576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862967.472600:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874709526504576:12345-0@lo:400:kworker.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862967.472608:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787862967.472675:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874709526504576:0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473083:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526504320:0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473134:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862967.473166:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526504832:0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473194:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862967.473220:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787862967.473226:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651682ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526504704:0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473250:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862967.473282:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504832 00000100:00100000:3.0:1787862967.473286:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504832 00000100:00100000:3.0:1787862967.473324:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504704 00000100:00100000:3.0:1787862967.473327:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504704 00000100:00100000:3.0:1787862967.473371:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787862967.473379:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526504832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473421:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526504832:12345-0@lo:400:kworker.0 Request processed in 43us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862967.473428:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787862967.473447:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787862967.473454:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526504704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473483:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874709526504704:12345-0@lo:400:kworker.0 Request processed in 30us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862967.473488:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:3.0:1787862967.473511:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787862967.473533:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651682ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874709526504704:0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.473544:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526504832:0@lo:400:kworker.0 00000100:00100000:2.0:1787862967.476129:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504448 00000100:00100000:2.0:1787862967.476147:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504448 00000100:00100000:2.0:1787862967.476244:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787862967.476255:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526504448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862967.476406:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526504448:12345-0@lo:400:kworker.0 Request processed in 152us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862967.476414:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787862967.479741:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787862967.480112:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504320 00000100:00100000:0.0:1787862967.480129:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504320 00000100:00100000:0.0:1787862967.480223:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787862967.480237:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526504320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862967.480393:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526504320:12345-0@lo:400:kworker.0 Request processed in 159us (7258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862967.480403:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787862967.480500:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526504448:0@lo:400:kworker.0 00000100:00100000:3.0:1787862967.481368:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526504320:0@lo:400:kworker.0 00010000:00010000:0.0:1787862967.708310:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862968.476567:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526504960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862968.476674:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862968.476890:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526504960 00000100:00100000:2.0:1787862968.476900:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526504960 00000100:00100000:2.0:1787862968.476991:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862968.477023:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526504960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862968.477118:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862968.477184:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526504960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862968.477192:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787862968.477249:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526504960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787862968.732301:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862969.202154:0:21072:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862969.202168:0:21072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862969.202691:0:21072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862969.202715:0:21072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862969.759316:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862970.781472:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787862971.204811:0:21124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787862971.204823:0:21124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787862971.205517:0:21124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1787862971.205526:0:21124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862971.597504:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862971.597568:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862971.597602:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862971.597655:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862971.597706:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078016 00000100:00100000:1.0:1787862971.597721:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078016 00000100:00100000:1.0:1787862971.597798:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:1.0:1787862971.597811:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517078016:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862971.597935:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517078016:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 126us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862971.597943:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 197 00000100:00100000:1.0:1787862971.597994:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078272 00000100:00100000:1.0:1787862971.597998:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078272 00000100:00100000:1.0:1787862971.598087:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:1.0:1787862971.598096:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517078272:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862971.598140:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517078272:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 45us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862971.598148:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 125 00000100:00100000:1.0:1787862971.598173:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078144 00000100:00100000:1.0:1787862971.598177:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078144 00000100:00100000:1.0:1787862971.598216:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078400 00000100:00100000:1.0:1787862971.598220:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078400 00000100:00100000:1.0:1787862971.598247:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:1.0:1787862971.598254:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402adfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517078144:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862971.598290:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402adfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517078144:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 36us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862971.598311:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 217 00000100:00100000:1.0:1787862971.598326:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 218 00000100:00100000:1.0:1787862971.598332:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402ade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517078400:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:1.0:1787862971.598361:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402ade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517078400:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 29us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862971.598366:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 218 00000100:00080000:1.0:1787862971.598595:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862971.598602:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787862971.805843:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787862972.572650:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787862972.572684:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402ade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526505088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862972.572797:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862972.572902:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505088 00000100:00100000:1.0:1787862972.572914:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505088 00000100:00100000:1.0:1787862972.572998:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787862972.573009:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402ade940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526505088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862972.574171:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862972.574267:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402ade940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526505088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1257us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862972.574277:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787862972.574330:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787862972.575242:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402ade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526505088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862972.579791:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526505344:0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.579911:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862972.579990:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787862972.579998:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526505216:0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.580058:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862972.582854:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526505728:0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.582936:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862972.582992:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402ade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526505600:0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.583023:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862972.586223:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787862972.586263:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526505472:0@lo:400:kworker.0 00000100:00100000:2.0:1787862972.587302:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505344 00000100:00100000:2.0:1787862972.593257:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505344 00000100:00100000:1.0:1787862972.597162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862972.597277:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505216 00000100:00100000:1.0:1787862972.597290:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505216 00000100:00100000:1.0:1787862972.597392:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787862972.597404:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526505216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.597487:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3282:x1874709526505216:12345-0@lo:400:kworker.0 Request processed in 85us (17444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862972.597495:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787862972.597539:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505728 00000100:00100000:1.0:1787862972.597543:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505728 00000100:00100000:0.0:1787862972.597629:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505600 00000100:00100000:0.0:1787862972.597634:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505600 00000100:00100000:2.0:1787862972.607123:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787862972.607156:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526505344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862972.607345:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526505344:12345-0@lo:400:kworker.0 Request processed in 201us (27434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862972.607355:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787862972.607905:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505472 00000100:00100000:1.0:1787862972.607918:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505472 00000100:00100000:1.0:1787862972.607942:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787862972.607952:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526505728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.608005:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874709526505728:12345-0@lo:400:kworker.0 Request processed in 56us (25068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862972.608012:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787862972.608025:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787862972.608030:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526505472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.608099:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874709526505472:12345-0@lo:400:kworker.0 Request processed in 68us (10950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862972.608125:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787862972.608193:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3282:1874709526505216:0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.608212:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874709526505728:0@lo:400:kworker.0 00000100:00100000:1.0:1787862972.608228:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526505344:0@lo:400:kworker.0 00000100:00080000:1.0:1787862972.608273:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787862972.608281:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787862972.608302:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874709526505472:0@lo:400:kworker.0 00000100:00100000:0.0:1787862972.608766:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787862972.608776:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526505600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862972.608827:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526505600:12345-0@lo:400:kworker.0 Request processed in 53us (25803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862972.608834:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787862972.609350:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402ade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526505600:0@lo:400:kworker.0 00010000:00010000:1.0:1787862972.843935:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862973.596290:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862973.596460:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526505856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862973.596570:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862973.596760:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505856 00000100:00100000:2.0:1787862973.596770:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505856 00000100:00100000:2.0:1787862973.596839:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787862973.596851:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526505856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787862973.596910:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787862973.596971:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526505856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862973.596979:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787862973.597797:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6516828780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526505856:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787862973.755435:0:21175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787862973.755455:0:21175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787862973.756022:0:21175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1787862973.756039:0:21175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862973.870572:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862974.878092:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862975.260513:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862975.260523:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862975.266779:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862975.266802:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787862975.906501:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862976.044913:0:21226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862976.044929:0:21226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862976.045783:0:21226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862976.045795:0:21226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787862976.713380:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862976.713449:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:2.0:1787862976.713492:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862976.713601:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078656 00000100:00100000:0.0:1787862976.713614:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078656 00000100:00100000:0.0:1787862976.713677:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078912 00000100:00100000:0.0:1787862976.713680:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078912 00000100:00100000:0.0:1787862976.713704:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 222 00000100:00100000:0.0:1787862976.713712:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517078656:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862976.713797:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516829a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2348:x1874709517078656:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 85us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862976.713805:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 222 00000100:00100000:0.0:1787862976.713822:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 223 00000100:00100000:0.0:1787862976.713839:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517078912:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862976.713864:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6516828b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2348:x1874709517078912:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862976.713870:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 223 00000100:00080000:0.0:1787862976.713889:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787862976.716057:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862976.716776:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078784 00000100:00100000:0.0:1787862976.716789:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078784 00000100:00100000:0.0:1787862976.716883:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00100000:0.0:1787862976.716896:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517078784:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862976.716990:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651682ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2348:x1874709517078784:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 98us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862976.716997:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 127 00000100:00080000:1.0:1787862976.717548:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862976.724132:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517078528 00000100:00100000:3.0:1787862976.724156:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517078528 00000100:00100000:3.0:1787862976.724492:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 199 00000100:00100000:3.0:1787862976.724504:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517078528:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862976.724611:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6537ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2348:x1874709517078528:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 109us (11117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862976.724635:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 199 00010000:00010000:1.0:1787862976.925642:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787862977.696647:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526506112:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.696759:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862977.696840:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526506368:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.696863:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526506624:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.696940:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862977.696952:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526506240:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.697000:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787862977.697001:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862977.697105:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506112 00000100:00100000:2.0:1787862977.697114:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506112 00000100:00100000:2.0:1787862977.697169:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506240 00000100:00100000:2.0:1787862977.697172:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506240 00000100:00100000:2.0:1787862977.697207:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787862977.697219:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526506112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.697226:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526505984:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.697283:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862977.702709:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787862977.702733:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526506240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862977.702855:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526506752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787862977.713863:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526506496:0@lo:400:kworker.0 00000100:00100000:2.0:1787862977.714593:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874709526506112:12345-0@lo:400:kworker.0 Request processed in 17360us (17818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862977.714612:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787862977.714839:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862977.714989:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fc603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526506240:12345-0@lo:400:kworker.0 Request processed in 12263us (17990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862977.714999:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1787862977.715032:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862977.715038:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787862977.715864:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874709526506112:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.717208:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506624 00000100:00100000:3.0:1787862977.717226:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506624 00000100:00100000:3.0:1787862977.717307:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506496 00000100:00100000:3.0:1787862977.717312:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506496 00000100:00100000:3.0:1787862977.717344:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787862977.717356:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526506624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.717478:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874709526506624:12345-0@lo:400:kworker.0 Request processed in 124us (20543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862977.717487:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787862977.717508:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787862977.717515:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526506496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.717551:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874709526506496:12345-0@lo:400:kworker.0 Request processed in 37us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862977.717579:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787862977.717606:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526505984 00000100:00100000:3.0:1787862977.717610:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526505984 00000100:00100000:3.0:1787862977.717643:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787862977.717650:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526505984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.717699:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a650af65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3284:x1874709526505984:12345-0@lo:400:kworker.0 Request processed in 49us (20417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862977.717706:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787862977.717778:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787862977.717849:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506368 00000100:00100000:3.0:1787862977.717854:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506368 00000100:00100000:3.0:1787862977.717874:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787862977.717879:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526506368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.717926:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526506368:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862977.717932:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787862977.717973:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526506368:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.718007:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651f8970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3284:1874709526505984:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.718035:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874709526506496:0@lo:400:kworker.0 00000100:00100000:3.0:1787862977.718072:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874709526506624:0@lo:400:kworker.0 00000100:00080000:0.0:1787862977.724364:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862977.725606:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862977.725677:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653460cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526506240:0@lo:400:kworker.0 00000100:00100000:0.0:1787862977.725846:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506752 00000100:00100000:0.0:1787862977.725853:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506752 00000100:00100000:0.0:1787862977.725909:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787862977.725920:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526506752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787862977.725965:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862977.726015:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526506752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862977.726023:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787862977.726462:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526506752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787862977.953110:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862978.440529:0:21278:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862978.440542:0:21278:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862978.441079:0:21278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862978.441092:0:21278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787862978.717255:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526506880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787862978.717383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862978.717617:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526506880 00000100:00100000:0.0:1787862978.717629:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526506880 00000100:00100000:0.0:1787862978.717701:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787862978.717713:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526506880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862978.717774:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862978.717846:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a65346e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526506880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862978.717855:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787862978.717968:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526506880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787862978.975139:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787862980.003209:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862981.020493:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862981.208713:0:21329:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862981.208723:0:21329:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862981.213744:0:21329:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862981.213766:0:21329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787862981.846680:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862981.846723:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862981.846761:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:1.0:1787862981.846814:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:3.0:1787862981.847089:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079040 00000100:00100000:3.0:1787862981.847100:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079040 00000100:00100000:3.0:1787862981.847163:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 201 00000100:00100000:3.0:1787862981.847175:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517079040:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862981.847255:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2347:x1874709517079040:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 81us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862981.847263:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 201 00000100:00100000:3.0:1787862981.847702:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079168 00000100:00100000:3.0:1787862981.847708:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079168 00000100:00100000:3.0:1787862981.847752:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079424 00000100:00100000:3.0:1787862981.847755:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079424 00000100:00100000:3.0:1787862981.847779:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 227 00000100:00100000:3.0:1787862981.847796:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517079168:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862981.847834:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2347:x1874709517079168:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 40us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862981.847841:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 227 00000100:00100000:3.0:1787862981.847855:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 228 00000100:00100000:3.0:1787862981.847861:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517079424:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862981.847884:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2347:x1874709517079424:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862981.847890:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 228 00000100:00100000:2.0:1787862981.848002:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079296 00000100:00100000:2.0:1787862981.848007:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079296 00000100:00100000:2.0:1787862981.848090:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 130 00000100:00100000:2.0:1787862981.848099:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517079296:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862981.848132:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2347:x1874709517079296:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862981.848138:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 130 00000100:00080000:0.0:1787862981.848429:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787862981.848435:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787862982.045495:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862982.813205:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526507008:0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813298:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862982.813354:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526507520:0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813384:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862982.813430:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787862982.813436:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526507136:0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813464:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862982.813483:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6402a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526507648:0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813519:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862982.813552:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526507392:0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813576:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862982.813595:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862982.813601:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526507264:0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813622:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862982.813655:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507008 00000100:00100000:2.0:1787862982.813661:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507008 00000100:00100000:2.0:1787862982.813708:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787862982.813717:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526507008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813767:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526507008:12345-0@lo:400:kworker.0 Request processed in 51us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862982.813787:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787862982.813821:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507520 00000100:00100000:2.0:1787862982.813825:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507520 00000100:00100000:2.0:1787862982.813858:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507648 00000100:00100000:2.0:1787862982.813862:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507648 00000100:00100000:2.0:1787862982.813874:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507392 00000100:00100000:2.0:1787862982.813877:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507392 00000100:00100000:2.0:1787862982.813889:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787862982.813896:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526507520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813931:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6402a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526507520:12345-0@lo:400:kworker.0 Request processed in 36us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862982.813937:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787862982.813958:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787862982.813965:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526507648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.813995:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526507648:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862982.814002:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787862982.814012:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787862982.814018:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526507392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.814072:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874709526507392:12345-0@lo:400:kworker.0 Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862982.814078:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787862982.814096:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507136 00000100:00100000:2.0:1787862982.814100:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507136 00000100:00100000:2.0:1787862982.814124:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507264 00000100:00100000:2.0:1787862982.814127:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507264 00000100:00100000:2.0:1787862982.814145:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787862982.814152:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526507136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.814183:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6518f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526507136:12345-0@lo:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862982.814188:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787862982.814200:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787862982.814205:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526507264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862982.814230:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526507264:12345-0@lo:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862982.814235:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787862982.814264:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787862982.814268:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787862982.814270:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787862982.815056:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526507776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862982.815109:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787862982.816130:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507776 00000100:00100000:1.0:1787862982.816153:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507776 00000100:00100000:1.0:1787862982.816214:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787862982.816226:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a651fd121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526507776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862982.816267:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862982.816342:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a651fd121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526507776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862982.816350:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787862982.816410:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526507776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787862982.827353:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526507264:0@lo:400:kworker.0 00000100:00100000:1.0:1787862982.827393:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874709526507392:0@lo:400:kworker.0 00000100:00100000:1.0:1787862982.827436:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526507136:0@lo:400:kworker.0 00000100:00100000:1.0:1787862982.827450:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526507648:0@lo:400:kworker.0 00000100:00100000:1.0:1787862982.827462:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fc62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526507008:0@lo:400:kworker.0 00000100:00100000:1.0:1787862982.827474:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6402a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526507520:0@lo:400:kworker.0 00010000:00010000:1.0:1787862983.069523:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862983.843740:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a640198da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526507904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787862983.843846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862983.843961:0:16197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526507904 00000100:00100000:0.0:1787862983.843970:0:16197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526507904 00000100:00100000:0.0:1787862983.844029:0:16197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787862983.844366:0:16197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a653d5fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526507904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862983.844408:0:16197:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862983.844669:0:16197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a653d5fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526507904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862983.844678:0:16197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787862983.844745:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a640198da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526507904:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787862983.893748:0:21380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862983.893759:0:21380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862983.895645:0:21380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862983.895664:0:21380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862984.095647:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787862985.116547:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862985.509529:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862985.509541:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862985.510128:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862985.510139:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787862986.146244:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787862986.739977:0:21432:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787862986.739990:0:21432:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787862986.741711:0:21432:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1787862986.741733:0:21432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787862986.955500:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862986.955549:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862986.955583:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862986.955612:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862986.955639:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079808 00000100:00100000:0.0:1787862986.955649:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079808 00000100:00100000:0.0:1787862986.955712:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:0.0:1787862986.955724:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517079808:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862986.955830:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517079808:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862986.955839:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 133 00000100:00100000:0.0:1787862986.955862:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079680 00000100:00100000:0.0:1787862986.955865:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079680 00000100:00100000:0.0:1787862986.955892:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079936 00000100:00100000:0.0:1787862986.955894:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079936 00000100:00100000:0.0:1787862986.955912:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 232 00000100:00100000:0.0:1787862986.955919:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a640198da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517079680:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862986.955949:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a640198da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517079680:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862986.955955:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 232 00000100:00100000:0.0:1787862986.955967:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 233 00000100:00100000:0.0:1787862986.955972:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a64031dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517079936:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862986.955994:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a64031dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517079936:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862986.956000:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 233 00000100:00080000:0.0:1787862986.956020:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862986.956025:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787862986.956436:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517079552 00000100:00100000:3.0:1787862986.956441:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517079552 00000100:00100000:3.0:1787862986.956482:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 203 00000100:00100000:3.0:1787862986.956489:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517079552:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:3.0:1787862986.956541:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517079552:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 52us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787862986.956549:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 203 00010000:00010000:1.0:1787862987.165529:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862987.932413:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526508032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862987.932506:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862987.932951:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526508288:0@lo:400:kworker.0 00000100:00100000:0.0:1787862987.933003:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862987.933026:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787862987.933032:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526508416:0@lo:400:kworker.0 00000100:00100000:0.0:1787862987.933103:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862987.933139:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508416 00000100:00100000:0.0:1787862987.933154:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508416 00000100:00100000:0.0:1787862987.933209:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787862987.933219:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526508416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787862987.933275:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874709526508416:12345-0@lo:400:kworker.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862987.933282:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787862987.933326:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874709526508416:0@lo:400:kworker.0 00000100:00100000:1.0:1787862987.933571:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508032 00000100:00100000:1.0:1787862987.933577:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508032 00000100:00100000:1.0:1787862987.933619:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787862987.933628:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526508032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787862987.933658:0:15003:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787862987.933716:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874709526508032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862987.933734:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787862987.933755:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508288 00000100:00100000:1.0:1787862987.933758:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508288 00000100:00100000:1.0:1787862987.933785:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787862987.933792:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526508288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787862987.933827:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874709526508288:12345-0@lo:400:kworker.0 Request processed in 35us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787862987.933834:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787862987.933848:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787862987.933852:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787862987.933873:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a653d9bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874709526508288:0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.934642:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526508544:0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.934700:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862987.934763:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a651fd12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874709526508032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787862987.934780:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787862987.934787:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526508160:0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.934816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862987.934845:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526508672:0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.934868:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787862987.934900:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508160 00000100:00100000:2.0:1787862987.934906:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508160 00000100:00100000:2.0:1787862987.934938:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787862987.934946:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526508160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.934988:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5934abbb-415c-4dd1-a04f-dfe9aec97c5f+19:3283:x1874709526508160:12345-0@lo:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862987.934996:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787862987.935026:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508544 00000100:00100000:2.0:1787862987.935030:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508544 00000100:00100000:2.0:1787862987.935087:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508672 00000100:00100000:2.0:1787862987.935090:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508672 00000100:00100000:2.0:1787862987.935271:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787862987.935280:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526508544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.935315:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874709526508544:12345-0@lo:400:kworker.0 Request processed in 37us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862987.935341:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787862987.935354:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787862987.935361:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526508672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.935392:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874709526508672:12345-0@lo:400:kworker.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862987.935399:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787862987.936918:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a64031dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5934abbb-415c-4dd1-a04f-dfe9aec97c5f:3283:1874709526508160:0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.936940:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874709526508672:0@lo:400:kworker.0 00000100:00100000:2.0:1787862987.936966:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874709526508544:0@lo:400:kworker.0 00000100:00080000:1.0:1787862987.938578:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787862988.192084:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787862988.956339:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787862988.962864:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a6511e8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526508800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787862988.963023:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787862988.963436:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709526508800 00000100:00100000:0.0:1787862988.963447:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709526508800 00000100:00100000:0.0:1787862988.963537:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787862988.963547:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6401d09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526508800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787862988.963596:0:15002:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787862988.963649:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6401d09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874709526508800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862988.963656:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787862988.964169:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a6511e8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874709526508800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787862989.213680:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787862990.165263:0:21482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: request on 0x200000bd1:0x4:0x0 is not SUCCEED on mds1 00010000:00010000:0.0:1787862990.238800:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787862991.261580:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787862992.090973:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862992.091014:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862992.091079:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862992.091110:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.60@tcp (source: 12345-192.168.202.60@tcp) 00000100:00100000:0.0:1787862992.091140:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080320 00000100:00100000:0.0:1787862992.091150:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080320 00000100:00100000:0.0:1787862992.091208:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:0.0:1787862992.091220:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517080320:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862992.091305:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a16fbf5-07bd-4add-b9e9-3111232e9331+6:2349:x1874709517080320:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862992.091321:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 135 00000100:00100000:0.0:1787862992.091345:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080192 00000100:00100000:0.0:1787862992.091349:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080192 00000100:00100000:0.0:1787862992.091375:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080448 00000100:00100000:0.0:1787862992.091378:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080448 00000100:00100000:0.0:1787862992.091400:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 237 00000100:00100000:0.0:1787862992.091408:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517080192:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862992.091438:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a16fbf5-07bd-4add-b9e9-3111232e9331+14:2349:x1874709517080192:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862992.091445:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 237 00000100:00100000:0.0:1787862992.091457:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00100000:0.0:1787862992.091464:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6511e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517080448:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:0.0:1787862992.091487:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6511e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bfe0e71-9fe3-4f4b-96d3-2f7a8cdbd8cf+6:2349:x1874709517080448:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787862992.091493:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 238 00000100:00080000:0.0:1787862992.091511:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787862992.091515:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787862992.091864:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874709517080064 00000100:00100000:2.0:1787862992.091868:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874709517080064 00000100:00100000:2.0:1787862992.091899:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.60@tcp, seq: 205 00000100:00100000:2.0:1787862992.091906:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517080064:12345-192.168.202.60@tcp:400:kworker.0 00000100:00100000:2.0:1787862992.091940:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6509b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec424a92-b33b-4ce7-b36b-6c8bccbb8254+13:2349:x1874709517080064:12345-192.168.202.60@tcp:400:kworker.0 Request processed in 35us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787862992.091947:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.60@tcp, seq: 205 00010000:00010000:2.0:1787862992.291643:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 37690 lines, 37690 kept, 0 dropped, 0 bad.